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Theorems and Proofs 


Theorems are presented in clear and mathematically 


THEOREM 2.9 — qf 4 and B are invertible matrices of size n, then AB is invertible and precise language. 
The Inverse (4B)-! = BA"! 
of a Product , Key theorems are also available via PowerPoint® 


Presentation on the instructor website. They can 
be displayed in class using a computer monitor or 
projector, or printed out for use as class handouts. 


Students will gain experience solving proofs 


PROOF To begin, observe that if £ is an elementary matrix, then, by Theorem 3.3, the next few state- 


pr esented in several different ways: ments are true. If E is obtained from / by interchanging two rows, then |E| = —1. If 
: . Soe E is obtained by multiplying a row of J by a nonzero constant c, then |E| = c. If E is 
© Some proofs are presented in outline form, omitting obtained by adding a multiple of one row of / to another row of /, then |E| = 1. Additionally, 


by Theorem 2.12, if E results from performing an elementary row operation on / and the 
same elementary row operation is performed on B, then the matrix EB results. It follows that 


the need for burdensome calculations. 


© Specialized exercises labeled Guided Proofs lead |EB| = |E| |B|. 
students through the initial steps of constructing This can be generalized to conclude that |, * + « E,E,B| = |E,| - - - |E>| |2,| |B], where 
eye E, is an elementary matrix. Now consider the matrix AB. If A is nonsingular, then, by 
proofs and then utilizing the results. Theorem 2.14, it can be written as the product of elementary matrices A = E,* + » EE, 


and you can write 


® The proofs of several theorems are left as exercises, 
. -_ ; 56. Guided Proof Prove Theorem 3.9: If A is a square matrix, then 
to give students additional practice. det(A) = det(A”). IAI [I 


Getting Started: To prove that the determinants of A and A? 
are equal, you need to show that their cofactor expansions are 
equal. Because the cofactors are + determinants of smaller 
matrices, you need to use mathematical induction. 


(i) Initial step for induction: If A is of order 1, then A = 
[a,,] = A’, so det(A) = det(A’) = ay). 

(ii) Assume the inductive hypothesis holds for all matrices 
of order n — 1. Let A be a square matrix of order n. 
Write an expression for the determinant of A by 
expanding by the first row. 

(iii) Write an expression for the determinant of A’ by 
expanding by the first column. 

(iv) Compare the expansions in (i) and (ii). The entries of 
the first row of A are the same as the entries of the first 
column of A’. Compare cofactors (these are the + 
determinants of smaller matrices that are transposes of 
one another) and use the inductive hypothesis to 


Real World Applications conclude that they are equal as well. 


REVISED! Each chapter ends with a section on 
real-life applications of linear algebra concepts, 
covering interesting topics such as: 


EXAMPLE 4| Forming Uncoded Row Matrices 


Write the uncoded row matrices of size 1 x 3 for the message MEET ME MONDAY. 


SOLUTION Partitioning the message (including blank spaces, but ignoring punctuation) into groups of 
three produces the following uncoded row matrices. 


(13 5 5] 20 0 13)f5 0 13) 015 14 4] [1 25 0] 


® Cryptography MEET _ME MONDAY _ 


© Computer graphics 


H Population grow th an d more! Note that a blank space is used to fill out the last uncoded row matrix. 


A full listing of the applications can be found in the INDEX OF APPLICATIONS 
Index of Applications inside the front cover. 
BIOLOGY AND LIFE SCIENCES COMPUTERS AND COMPUTER SCIENCE 
Calories burned, 117 Computer graphics, 410-413, 415, 418 
Population Computer operator, 142 
of deer, 43 
of rabbits, 459 ELECTRICAL ENGINEERING 
Population growth, 458-461, 472, 476, 477 Current flow in networks, 33, 36, 37, 40, 44 


Reproduction rates of deer, 115 Kirchhoff’s Laws, 35, 36 
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Conceptual Understanding 


CHAPTER OBJECTIVES NEW! Chapter Objectives are now listed on each 

@ Find the determinants of a 2 x 2 matrix and a triangular matrix. chapter opener Paar: These objectives highlight the key 
@ Find the minors and cofactors of a matrix and use expansion by cofactors to find the concepts covered in the chapter, to serve as a guide to 
determinant of a matrix. student learning. 

Use elementary row or column operations to evaluate the determinant of a matrix. 
Recognize conditions that yield zero determinants. 

Find the determinant of an elementary matrix. 


Use the determinant and properties of the determinant to decide whether a matrix is singular 
or nonsingular, and recognize equivalent conditions for a nonsingular matrix. 


@ Verify and find an eigenvalue and an eigenvector of a matrix. 


The Discovery features are designed Discovery 
- - to help students develop an intuitive 
True or False? In Exercises 62—65, determine whether each state- : 3 
ment is true or false. If a statement is true, give a reason or cite an understanding of mathematical 6 
appropriate statement from the text. Ht a statement is false, provide concepts and relationships. 0 ; 
an example that shows the statement is not true in all cases or cite an 1 1 2 


appropriate statement from the text. 
62. (a) The nullspace of A is also called the solution space of A. Use a graphing utility or 
(b) The nullspace of A is the solution space of the homogeneous computer software program to 
system Ax = 0. find A~'. Compare det(A~') 
with det(A). Make a conjecture 


63. (a) If an m x n matrix A is row-equivalent to an m x n matrix Wd i ‘ : 
( mxn q mxn True or False? exercises test students about the determinant ofthe 


B, then the row space of A is equivalent to the row space 


a knowledge of core concepts. Students are inverse of a matrix. 
(b) If A is an m x n matrix of rank r, then the dimension of the asked to give examples or justifications to 
solution space of Ax = Ois m — r. support their conclusions. 


Graphics and Geometric Emphasis 


A Visualization skills are necessary for the understanding of mathematical concepts and 
theory. The Sixth Edition includes the following resources to help develop these skills: 


™® Graphs accompany examples, particularly when representing vector spaces and 
inner product spaces. 


© Computer-generated illustrations offer geometric interpretations of problems. 


z Ellipsoid 
Figure 5.13 2 
e 
Trace Plane 
Ellipse Parallel to xy-plane 
Ellipse Parallel to xz-plane 
Ellipse Parallel to yz-plane 


The surface is a sphere if a = b = c # 0. 


“xy-trace 
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Problem Solving and Review 


53. u = (0,1, Y2), v=(-1, V2,-1) 83. u =(-43,3), v=(2,-4) 
54. u = (-1, 3,2), v=(V2,-1,- V2) 84. u=(1,-1), v=(0.-1) 
55. u = (0,2,2,-1,1,-2), v= (2,0, 1, 1,2, -2) 85. u = (0,1,0), v= (1, -2,0) 
56. u = (1, 2,3, -2,-1,-3), v=(-1,0,2, 1,2, -3) 86. u=(0,1,6), v=(1,-2,-1) 
57. u = (-1,1,2,-1,1,1,-2, 0), 

v= (-1,0, 1,2, -2, 1,1, -2) 

an 


58. 


(3, -1,2, 1,0, 1,2, -1), 
v=(1,2,0,—1,2, -2.1,0) 4) In Exercises 89-92, use a graphing utility or computer software 
program with vector capabilities to determine whether u and v are 


In Exercises 59-62, verify the Cauchy-Schwarz Inequality for the orthogonal, parallel, or neither. 


given vectors. 


59. u = (3,4), v = (2, -3) 


60. u=(—1,0), v=(1,1) 
61. u = (1,1,-2), v= (1, —3, —2) 
62. u = (1,—1,0), v=(0,1,-1) 


In Exercises 63-72, find the angle @ between the vectors. 
63. u = (3,1), v= (-2,4) 
64. u = (2,-1), v= (2,0) 


Writing In Exercises 93 and 94, determine if the vectors are 
orthogonal, parallel, or neither. Then explain your reasoning. 

93. u = (cos @, sin 6, —1), 
94, u = (—sin 0, cos 4, 1), 


v = (sin 6, —cos 6, 0) 


v = (sin @, ~cos 6, 0) 


65. u= (cos a sin 2), y 


REVISED! Comprehensive section and chapter exercise 
sets give students practice in problem-solving techniques 
and test their understanding of mathematical concepts. A 
wide variety of exercise types are represented, including: 
M® Writing exercises 
™ Guided Proof exercises 


™ Technology exercises, indicated throughout the text 
with 49). 


™ Applications exercises 


@ Exercises utilizing electronic data sets, indicated 
by [M and found on the student website at 
college.hmco.com/picNarsonELA6e 


CHAPTER 3 tora 


Each chapter includes two Chapter 


Projects, which offer the opportunity for 
group activities or more extensive homework 
assignments. 


Chapter Projects are focused on 
theoretical concepts or applications, and 
many encourage the use of technology. 


1 Eigenvalues and Stochastic Matrices 


In Section 2.5, you studied a consumer preference model for competing cable 
television companies. The matrix representing the transition probabilities was 


0.70 0.15 0.15 
P =| 0.20 0.80 0.15 |. 
0.10 0.05 0.70 


When provided with the initial state matrix X, you observed that the number of 
subscribers after 1 year is the product PX. 


15,000 OF 0m Ons 0.15] [ 15,000 23,250 
X =| 20,000) > PX=|0.20 0.80 0.15] | 20,000] = | 28,750 
65,000 0.10 0.05 0.70 | | 65,000. 48,000 


[ eats ee-ee Cumulative Test 


Cumulative Tests follow chapters 3, 5, 
and 7, and help students synthesize the 
knowledge they have accumulated 
throughout the text, as well as prepare for 
exams and future mathematics courses. 


Take this test as you would take a test in class. After you are done, check your work against the 
answers in the back of the book. 
1. Given the vectors vy = (1, —2) and w = (2, —5), find and sketch each vector. 
(a) V+w (b) 3v (c) 2v — 4w 
2. If possible, write w = (2, 4, 1) as a linear combination of the vectors V,, V>, and v3. 


vy, =(1,2,0), v,=(-1,0,1),  v; = 0,3,0) 


3. Prove that the set of all singular 2 x 2 matrices is not a vector space. 


Historical Emphasis 


HISTORICAL NOTE 


Augustin-Louis Cauchy 
(1789-1857) 

was encouraged by Pierre Simon 
de Laplace, one of France’s lead- 
ing mathematicians, to study 
mathematics. Cauchy is often 
credited with bringing rigor 
to modern mathematics. To 
read about his work, visit 
college.hmco.com/pic/larsonELA6e. 


PowerPoint® Presentation. 


NEW! Historical Notes are included throughout the text and feature brief biographies 
of prominent mathematicians who contributed to linear algebra. 


Students are directed to the Web to read the full biographies, which are available via 
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Computer Algebra Systems and Graphing Calculators 


may appear as: 


Technol ogy You can use a graphing utility or computer software program to find the unit vector for a given 
Note Mguag For example, you can use a graphing utility to find the unit vector for v = (—3, 4), which 


EXAMPLE 7 
NEW! Online Technology Guide provides the coverage 


students need to use computer algebra systems and 
graphing calculators with this text. 


Provided on the accompanying student website, this 

guide includes CAS and graphing calculator keystrokes 
for select examples in the text. These examples feature 
an accompanying Technology Note, directing students to 
the Guide for instruction on using their CAS/graphing 
calculator to solve the example. 


In addition, the Guide provides an Introduction to 
MATLAB, Maple, Mathematica, and Graphing 
Calculators, as well as a section on Technology Pitfalls. 


The Technology Note feature in the text indicates 
how students can utilize graphing calculators and 
computer algebra systems appropriately in the 
problem-solving process. 


Using Elimination to Rewrite a System in Row-Echelon Form 


Technology 
Note 


You can use a computer software 
program or graphing utility with 

a built-in power regression 
program to verify the result of 
Example 10. For example, using 
the data in Table 5.2 anda 
graphing utility, a power fit 
program would result in an 
answer of (or very similar to) 

y = 1,00042x'#9954, Keystrokes 
and programming syntax for 
these utilities/programs applicable 
to Example 10 are provided in the 
Online Technology Guide, 
available at college.hmco.com/ 
pic/larsonELA6e. 


Solve the system. 
x-2y+3z= 9 
=x +3y =-4 
2x — Sy + 5¢= 17 


Keystrokes for TI-83 

Enter the system into matrix A. 

To rewrite the system in row-echelon form, use the following keystrokes. 
(MATRX) (>) (ALPHA) [A] (MATRX) (ENTER) (ENTER) 


Keystrokes for TI-83 Plus 

Enter the system into matrix A. 

To rewrite the system in row-echelon form, use the following keystrokes. 
(nd) [MATRX] (2) (ALPHA) [A] @nd) [MATRX] (ENTER) (ENTER) 


Keystrokes for TI-84 Plus 

Enter the system into matrix A. 

To rewrite the system in row-echelon form, use the following keystrokes. 
(2nd) [MATRIX] (=) (ALPHA) [A] (2nd) [MATRIX] (ENTER) (ENTER) 


Keystrokes for TI-86 

Enter the system into matrix A. 

To rewrite the system in row-echelon form, use the following keystrokes. 
(2nd) [MATRX] (F4) (F4) (ALPHA) [A] (ENTER) 


Part I: Texas Instruments TI-83, TI-83 Plus, TI-84 Plus Graphing Calculator 


I.1 Systems of Linear Equations 


it off to conserve battery power by pressing 2nd and then OFF. 


CLEAR. 


1.1.1 Basics: Press the ON key to begin using your TI-83 calculator. If you need to adjust the display 
contrast, first press 2nd, then press and hold Zi (the up arrow key) to increase the contrast or Ka (the down 
arrow key) to decrease the contrast. As you press and hold F¥ or BK, an integer between 0 (lightest) and 
9 (darkest) appears in the upper right corner of the display. When you have finished with the calculator, turn 


Check the TI-83’s settings by pressing MODE. If necessary, use the arrow key to move the blinking cursor 
to a setting you want to change. Press ENTER to select a new setting. To start, select the options along the 
left side of the MODE menu as illustrated in Figure I.1: normal display, floating display decimals, radian 
measure, function graphs, connected lines, sequential plotting, real number system, and full screen display. 
Details on alternative options will be given later in this guide. For now, leave the MODE menu by pressing 


The Graphing Calculator Keystroke Guide offers 
commands and instructions for various calculators 


and includes examples with step-by-step solutions, 
technology tips, and programs. 


The Graphing Calculator Keystroke Guide covers 


Also available on the student website: 


TI-83/TI-83 PLUS, TI-84 PLUS, TI-86, TI-89, TI-92, 
and Voyage 200. 


© Electronic Data Sets are designed to be used with select exercises in the text and help students reinforce 
and broaden their technology skills using graphing calculators and computer algebra systems. 


© MATLAB Exercises enhance students’ understanding of concepts using MATLAB software. These 


optional exercises correlate to chapters in the text. 
xii 


Additional Resources @ Get More from Your Textbook 


Instructor Resources Student Resources 


Instructor Website This website offers instructors a Student Website This website offers comprehensive study 
variety of resources, including: resources, including: 


® Instructor’s Solutions Manual, featuring complete ™ NEW! Online Multimedia eBook 
solutions to all even-numbered exercises in the text. ™ NEW! Online Technology Guide 
® Digital Art and Figures, featuring key theorems ® Electronic Simulations 
from the text. ™ MATLAB Exercises 
® Graphing Calculator Keystroke Guide 
™ Chapters 8, 9, and 10 
™ Electronic Data Sets 
© Historical Note Biographies 


NEW! HM Testing™ (Powered by Diploma®) “Testing Student Solutions Manual Contains complete solutions to 
the way you want it” HM Testing provides instructors all odd-numbered exercises in the text. 

with a wide array of new algorithmic exercises along with 

improved functionality and ease of use. Instructors can 

create, author/edit algorithmic questions, customize, and 

deliver multiple types of tests. 


HM Math SPACE with Eduspace®: Houghton Mifflin’s Online Learning Tool (powered by Blackboard®) 
This web-based learning system provides instructors and students with powerful course management tools and 
text-specific content to support all of their online teaching and learning needs. Eduspace now includes: 


M NEW! WebAssign® Developed by teachers, for teachers, WebAssign allows instructors to create assignments from an 
abundant ready-to-use database of algorithmic questions, or write and customize their own exercises. With WebAssign, 
instructors can: create, post, and review assignments 24 hours a day, 7 days a week; deliver, collect, grade, and record 
assignments instantly; offer more practice exercises, quizzes and homework; assess student performance to keep 
abreast of individual progress; and capture the attention of online or distance-learning students. 

NZ SMARTHINKING® Live, Online Tutoring SMARTHINKING provides an easy-to-use 
SMARTHINKI and effective online, text-specific tutoring service. A dynamic Whiteboard and a 
. ister youknow Graphing Calculator function enable students and e-structors to collaborate easily. 


Online Course Content for Blackboard®, WebCT®, and eCollege® Deliver program- or text-specific Houghton 
Mifflin content online using your institution’s local course management system. Houghton Mifflin offers homework and 
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What Is Linear Algebra? 


Original Flight 
° > <> 
Sy 
Return Flight 
—— 


—— e 
—— 


x+y = 1000 


(900, 100) 


The lines intersect at (900, 100). 


To answer the question “What is linear algebra?,” take a closer look at what you will 
study in this course. The most fundamental theme of linear algebra, and the first topic 
covered in this textbook, is the theory of systems of linear equations. You have probably 
encountered small systems of linear equations in your previous mathematics courses. For 
example, suppose you travel on an airplane between two cities that are 5000 kilometers 
apart. If the trip one way against a headwind takes 64 hours and the return trip the same 
day in the direction of the wind takes only 5 hours, can you find the ground speed of the 
plane and the speed of the wind, assuming that both remain constant? 

If you let x represent the speed of the plane and y the speed of the wind, then the 
following system models the problem. 


6.25(x — y) = 5000 
5(x + y) = 5000 
This system of two equations and two unknowns simplifies to 
x—-y= 800 
x + y = 1000, 


and the solution is x = 900 kilometers per hour and y = 100 kilometers per hour. 
Geometrically, this system represents two lines in the xy-plane. You can see in the figure 
that these lines intersect at the point (900, 100), which verifies the answer that was 
obtained. 

Solving systems of linear equations is one of the most important applications of linear 
algebra. It has been argued that the majority of all mathematical problems encountered in 
scientific and industrial applications involve solving a linear system at some point. Linear 
applications arise in such diverse areas as engineering, chemistry, economics, business, 
ecology, biology, and psychology. 

Of course, the small system presented in the airplane example above is very easy 
to solve. In real-world situations, it is not unusual to have to solve systems of hundreds 
or even thousands of equations. One of the early goals of this course is to develop an 
algorithm that helps solve larger systems in an orderly manner and is amenable to 
computer implementation. 


Systems of 


Linear Equations 


1.1 Introduction to Systems 
of Linear Equations 

1.2 Gaussian Elimination 
and Gauss-Jordan 
Elimination 

1.3 Applications of Systems 
of Linear Equations 


HISTORICAL NOTE 


Carl Friedrich Gauss 
(1777-1855) 

is often ranked—along with 
Archimedes and Newton—as one 
of the greatest mathematicians in 
history. To read about his contri- 
butions to linear algebra, visit 
college.hmco.com/pic/larsonELA6e. 


CHAPTER OBJECTIVES 


Recognize, graph, and solve a system of linear equations in n variables. 

Use back-substitution to solve a system of linear equations. 

Determine whether a system of linear equations is consistent or inconsistent. 

Determine if a matrix is in row-echelon form or reduced row-echelon form. 

Use elementary row operations with back-substitution to solve a system in row-echelon form. 
Use elimination to rewrite a system in row-echelon form. 


Write an augmented or coefficient matrix from a system of linear equations, or translate a 
matrix into a system of linear equations. 


® Solve a system of linear equations using Gaussian elimination and Gaussian elimination with 
back-substitution. 


Solve a homogeneous system of linear equations. 


M@ Set up and solve a system of equations to fit a polynomial function to a set of data points, 
as well as to represent a network. 


1.1 | Introduction to Systems of Linear Equations 


Linear algebra is a branch of mathematics rich in theory and applications. This text strikes 
a balance between the theoretical and the practical. Because linear algebra arose from the 
study of systems of linear equations, you shall begin with linear equations. Although some 
material in this first chapter will be familiar to you, it is suggested that you carefully study 
the methods presented here. Doing so will cultivate and clarify your intuition for the more 
abstract material that follows. 

The study of linear algebra demands familiarity with algebra, analytic geometry, and 
trigonometry. Occasionally you will find examples and exercises requiring a knowledge of 
calculus; these are clearly marked in the text. 

Early in your study of linear algebra you will discover that many of the solution 
methods involve dozens of arithmetic steps, so it is essential to strive to avoid careless 
errors. A computer or calculator can be very useful in checking your work, as well as in 
performing many of the routine computations in linear algebra. 
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EXAMPLE 1 


Linear Equations in n Variables 


Recall from analytic geometry that the equation of a line in two-dimensional space has the form 
a,x + a,y = b, a), 5, and b are constants. 


This is a linear equation in two variables x and y. Similarly, the equation of a plane in 
three-dimensional space has the form 


ax + a,y + 4,2 = b, a), a5, a3, and Db are constants. 


Such an equation is called a linear equation in three variables x, y, and z. In general, a 
linear equation in n variables is defined as follows. 


REMARK: Letters that occur early in the alphabet are used to represent constants, and 
letters that occur late in the alphabet are used to represent variables. 


Linear equations have no products or roots of variables and no variables involved in 


trigonometric, exponential, or logarithmic functions. Variables appear only to the first 
power. Example | lists some equations that are linear and some that are not linear. 


Examples of Linear Equations and Nonlinear Equations 


Each equation is linear. 
(a) 3x + 2y =7 (b) jx ty-— m= J/2 
(c) x, — 2x, + 10x,+%,=0 @) (sin z) x, — 4x, = & 


Each equation is not linear. 


(a) xy t+z=2 (b) e* — 2y =4 
F 1 1 
(c) sinx, + 2x, — 3x, =0 oe 


A solution of a linear equation in n variables is a sequence of n real numbers s,, s5, 
S3,. . ., 8, arranged so the equation is satisfied when the values 


xy = Sy, Xo = 8, x3 = 83, ae Xx, = S85 


Section 1.1 Introduction to Systems of Linear Equations 3 


are substituted into the equation. For example, the equation 


x, + 2x, =4 
is satisfied when x, = 2 and.x, = 1. Some other solutions are x, = —4 and x, = 4,x, = 0 
and x, = 2, and x, = —2 and x, = 3. 


The set of all solutions of a linear equation is called its solution set, and when this set 
is found, the equation is said to have been solved. To describe the entire solution set of a 
linear equation, a parametric representation is often used, as illustrated in Examples 2 
and 3. 


EXAMPLE 2| Parametric Representation of a Solution Set 


Solve the linear equation x, + 2x, = 4. 


SOLUTION To find the solution set of an equation involving two variables, solve for one of the variables 
in terms of the other variable. If you solve for x, in terms of x,, you obtain 


x, = 4 —- 2x). 


In this form, the variable x, is free, which means that it can take on any real value. The 
variable x, is not free because its value depends on the value assigned to x,. To represent 
the infinite number of solutions of this equation, it is convenient to introduce a third 
variable ¢ called a parameter. By letting x, = f, you can represent the solution set as 


x, =4- 21, xX, =f, tis any real number. 


Particular solutions can be obtained by assigning values to the parameter f. For instance, 
t = 1 yields the solution x, = 2 and x, = 1, and t = 4 yields the solution x, = —4 and 
xX, =4. 


The solution set of a linear equation can be represented parametrically in more than 
one way. In Example 2 you could have chosen x, to be the free variable. The parametric 
representation of the solution set would then have taken the form 


1 = =2-48, si 1 numb 
x, = 8, X4 38, 1S any real number. 


For convenience, choose the variables that occur last in a given equation to be free variables. 


EXAMPLE 3| Parametric Representation of a Solution Set 


Solve the linear equation 3x + 2y — z = 3. 


SOLUTION Choosing y and z to be the free variables, begin by solving for x to obtain 
3x =3-2y+ z 
2 1 
x=1-— 5y + 42. 
Letting y = s and z = f, you obtain the parametric representation 


x=1-4s +41, y=5S, z=t 
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where s and ¢ are any real numbers. Two particular solutions are 


x=ly=0,z=0 and x=ly=1,z=2. 


Systems of Linear Equations 


A system of m linear equations in n variables is a set of m equations, each of which is 
linear in the same n variables: 


AyjX + AyyX_ + Ay3xz +++ + + a),X, = dD, 
Ay4X + AgyXq + Ag3X%3 + * + + Ayy_X, = by 
z)X1 + z9Xq + A33X3 ++ + + + Ay,X, = bg 
Ani X + Aina*2 + Ain3*3 ape oe Ginn*n = Dy: 


REMARK: The double-subscript notation indicates a;; is the coefficient of x; in the ith 


equation. 
A solution of a system of linear equations is a sequence of numbers 5), 55, 53,. . -.S, 
that is a solution of each of the linear equations in the system. For example, the system 
3x, + 2x, = 3 
—x,+ x,=4 
has x, = —1 and x, = 3 as a solution because both equations are satisfied when x, = — 1 


and x, = 3. On the other hand, x, = | and x, = 0 is not a solution of the system because 
these values satisfy only the first equation in the system. 


BTEYeCM TAY Graph the two lines 
K-y=1 
2x-y=0 

in the xy-plane. Where do they intersect? How many solutions does this system of linear equations 


have? 
Repeat this analysis for the pairs of lines 


3x -y=1 xx - y=! 
3x -y=0 6x — 2y = 2. 


In general, what basic types of solution sets are possible for a system of two equations in 
two unknowns? 


EXAMPLE 4 
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It is possible for a system of linear equations to have exactly one solution, an infinite 
number of solutions, or no sQye—emmiepystem of linear equations is called consistent if it 


has at least one solution ai (inconsistent f it has no solution. 


Systems of Two Equations in Two Variables 


SOLUTION 


Solve each system of linear equations, and graph each system as a pair of straight lines. 


(a)xty= 3 (b) x+ y=3 (c)x+y=3 
x-y=—-l 2x + 2y=6 x+y=l1 
(a) This system has exactly one solution, x = | and y = 2. The solution can be obtained by 


adding the two equations to give 2x = 2, which implies x = 1 and so y = 2. The graph 
of this system is represented by two intersecting lines, as shown in Figure 1.1(a). 


(b) This system has an infinite number of solutions because the second equation is the 
result of multiplying both sides of the first equation by 2. A parametric representation 
of the solution set is shown as 

x=3-1, y =t, fis any real number. 


The graph of this system is represented by two coincident lines, as shown in 
Figure 1.1(b). 


(c) This system has no solution because it is impossible for the sum of two numbers to be 
3 and | simultaneously. The graph of this system is represented by two parallel lines, 
as shown in Figure 1.1(c). 


(a) Two intersecting lines: (b) Two coincident lines: (c) Two parallel lines: 
x+ty= 3 x+ y=3 xt+ty=3 
x-y=-l 2x + 2y =6 xty=1 

Figure 1.1 


Example 4 illustrates the three basic types of solution sets that are possible for a system 
of linear equations. This result is stated here without proof. (The proof is provided later in 
Theorem 2.5.) 
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Number of Solutions For a system of linear equations in n variables, precisely one of the following is true. 


of a System of 1. The system has exactly one solution (consistent system). 
Linear Equations 2. The system has an infinite number of solutions (consistent system). 
. The system has no solution (inconsistent system). 


incons ent 
Solving a System of Linear Equations 


Which system is easier to solve algebraically? 


x—2y+3z= 9 x—2y+ 3z=9 
—x + 3y =-4 y+3z=5 
2x —5y+5z= 17 z=2 


The system on the right is clearly easier to solve. This system is in row-echelon form, 
which means that it follows a stair-step pattern and has leading coefficients of 1. To solve 
such a system, use a procedure called back-substitution. 


EXAMPLE 5| Using Back-Substitution to Solve a System in Row-Echelon Form 


Use back-substitution to solve the system. 


x—-2y= 5 Equation 1 
y= -2 Equation 2 
SOLUTION From Equation 2 you know that y = —2. By substituting this value of y into Equation 1, 
you obtain 
x — 2(-2) =5 Substitute y = —2. 
x=1. Solve for x. 
The system has exactly one solution: x = | and y = —2. 


The term “back-substitution” implies that you work backward. For instance, in Example 
5, the second equation gave you the value of y. Then you substituted that value into the first 
equation to solve for x. Example 6 further demonstrates this procedure. 


EXAMPLE 6| Using Back-Substitution to Solve a System in Row-Echelon Form 


Solve the system. 


U x — 2y+ 3z=9 Equation 1 
3 > Ry RK, y+ 3z=5 Equation 2 


z=2 Equation 3 


SOLUTION 


Operations That Lead to 
Equivalent Systems of 
Equations 


EXAMPLE 7 
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From Equation 3 you already know the value of z. To solve for y, substitute z = 2 into 
Equation 2 to obtain 


y+3(2)= 5 Substitute z = 2. 
y=-1. Solve for y. 
Finally, substitute y = —1 and z = 2 in Equation | to obtain 
x — 2(-—1) + 3(2) =9 Substitute y = —1, z = 2. 
x=1. Solve for x. 
The solution is x = 1, y = —1, and z = 2. 


Two systems of linear equations are called equivalent if they have precisely the same 
solution set. To solve a system that is not in row-echelon form, first change it to an 
equivalent system that is in row-echelon form by using the operations listed below. 


Each of the following operations on a system of linear equations produces an equivalent 
system. 


1. Interchange two equations. 
2. Multiply an equation by a nonzero constant. 
3. Add a multiple of an equation to another equation. 


Rewriting a system of linear equations in row-echelon form usually involves a chain 
of equivalent systems, each of which is obtained by using one of the three basic operations. 
This process is called Gaussian elimination, after the German mathematician Carl 
Friedrich Gauss (1777-1855). 


Using Elimination to Rewrite a System in Row-Echelon Form 


x—-2y+3z= 9 

= By =-4 

2x — 5y + 5z= 17 
Although there are several ways to begin, you want to use a systematic procedure that can be 


applied easily to large systems. Work from the upper left corner of the system, saving the x 
in the upper left position and eliminating the other x’s from the first column. 


x—2y+3z= 9 Adding the first equation to 
y+3z= 5 = the second equation produces 
2x — Sy + 5z=17 a new second equation. 
x—2y+3z= 9 Adding —2 times the first 
y+ 3z= equation to the third equation 


-y- z=-1 <——_ produces a new third equation. 
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Now that everything but the first x has been eliminated from the first column, work on the 
second column. 


x — 2y+ 3z=9 
Adding the second equation to 
yt3z=5 the third equation produces 
2z=4 <= anew third equation. 


Multiplying the third equation 
by } produces a new third 
gi 2 <= equation. 


This is the same system you solved in Example 6, and, as in that example, the solution is 


x= 1, y=—-1, z= 2. 


Each of the three equations in Example 7 is represented in a three-dimensional 
coordinate system by a plane. Because the unique solution of the system is the point 


@ yz) = (1,=1,2), 


EXAMPLE 8 
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Because many steps are required to solve a system of linear equations, it is very easy to 
make errors in arithmetic. It is suggested that you develop the habit of checking your 
solution by substituting it into each equation in the original system. For instance, in 


Example 7, you can check the solution x = 1, y = —1, and z = 2 as follows. 
Equation 1: (1) ~ 2(— 1) a 3(2) = 2 Substitute solution in 
Equation 2: — (1) + 3(- 1) =A each equation of the 


original system. 


Equation 3: 2(1) — 5(—1) + 5(2) 17 


Each of the systems in Examples 5, 6, and 7 has exactly one solution. You will now look 
at an inconsistent system—one that has no solution. The key to recognizing an inconsistent 
svstem is reaching a false statement such as 0 = 7 at some stage of the elimination process. 


An Inconsistent System 


SOLUTION 


Solve the system. 
x, — 3x, + x= 


2%, —- %—-2x%,= 2 


xy F 2% = 3xp = 1 
X,—3xy,+ B= 1 Adding — 2 times the first 
5 Xy 4x,= 0 <= equation to the second equation 
. produces a new second equation. 
x, + 2%, — 3x, = -1 


xX, — 3x, + x= 
. Adding —1 times the first 
5x, — 4x, = 0 equation to the third equation 


5x, — 4x, = -2 <= produces a new third equation. 


(Another way of describing this operation is to say that you subtracted the first equation 
from the third equation to produce a new third equation.) Now, continuing the elimination 
process, add —1 times the second equation to the third equation to produce a new third 
equation. 


x, —-3x%,+ x= 1 
Adding —1 times the second 
5x, — 4x3 = 0 equation to the third equation 
0=-2 <= produces a new third equation. 


Because the third “equation” is a false statement, this system has no solution. Moreover, 
because this system is equivalent to the original system, you can conclude that the original 
system also has no solution. 
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This section ends with an example of system of linear equations that has an infinite 
number of solutions. You can represent the solution set for such a system in parametric 
form, as you did in Examples 2 and 3. 


EXAMPLE 9|_ A System with an Infinite Number of Solutions 


Solve the system. 


X_ —- xy = 
% — 3x4, = -1 
= Xp SKS = 1 


Begin by rewriting the system in row-echelon form as follows. 


x — 3 x4 = iI << The first two equations 

H- 4%= O i are interchanged. 
=1y 7 3x, = 1 

x — 343, = —1 Adding the first equation to 

X,—- x= O the third equation produces 
3 = 3 X35 = 0 i a new third equation. 

x) 7 3X3 aia Adding —3 times the second 

X,- xX, = O equation to the third equation 
Oo= O — eliminates the third equation. 


Because the third equation is unnecessary, omit it to obtain the system shown below. 
x, — 3x,=—1 
Xy- +3 = O 
To represent the solutions, choose x, to be the free variable and represent it by the 
parameter ¢. Because x, = x3, and x, = 3x3, — 1, you can describe the solution set as 


x, = 3t- 1, xX, =F, X3 =, tis any real number. 


Graph the two lines represented by the system of equations. 
x-2’€y= | 
=2h .5V = 5 
You can use Gaussian elimination to solve this system as follows. 
x-2d’= 1 x-d’=1 x=3 
-y=-1 meee 
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In Exercises 1-6, determine whether the equation is linear in the 21. 3x — 5y =7 22. —x + 3y = 17 
variables x and y. 2x+ y=9 4x + 3y= 7 
1. 2x — 3y =4 2. 3x — 4xy = 0 23, 2x -—y= 5 24. x —S5y= 21 
a, = y = TI 6x + 5y = 21 
3.-+--1=0 4°+y=4 = = 
yx : a5, 2342 t 4 26, #—+ + 254 - 
5. 2sinx —y = 14 6. (sin 2)x — y = 14 x —-y=12 x-2y=5 
In Exercises 7—10, find a parametric representation of the solution 27. 0.05x — 0.03y = 0.07 28. 0.2x — 0.5y = —27.8 
set of the linear equation. 0.07x + 0.02y = 0.16 0.3x + 0.4y = 68.7 
7. 2x — 4y =0 8. 3x —3y =9 
aay *~ 2Y 2.54251 30, Sx + ty = 5 
9xtyt+z=1 10. 13x, — 26x, + 39x; = 13 4 6 3 6 3 
x= y= 3 4x+y=4 
In Exercises 11—16, use back-substitution to solve the system. 
11. x, — x, = 2 12. 2x, — 4x, = 6 
X, = 3 3x5 = 
13. -2 yo Za 4.x - y = 
2y+ z7= 2y+ z= 
1 
az = 3z = 
15. 5x, + 2x, + x, =0 16. x, +x, +x, =0 
2X, + X5 a Xy =0 
In Exercises 17-30, graph each system of equations as a pair of 
lines in the xy-plane. Solve each system and interpret your answer. 31. —3x— y=3 32. 4x— Sy= 3 
17, y= 1%. x+3y=2 war ay T se ee 
x-y=2 -—x+2y=3 ee wee 34. 9x — 4y = 5 
5x + =0 ty +4ty=0 
1% x%x- y=l 20. sx —ty= 1 : ; ; a 
- Has cy 35. 4x- 8y=9 36. —5.3x +2.1y = 1.25 
ales ale ay 0.8x — 1.6y = 1.8 15.9x — 6.3y = —3.75 


The symbol 4) indicates an exercise in which you are instructed to use a graphing utility or 
a symbolic computer software program. 
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In Exercises 37-56, solve the system of linear equations. 


37. X= X= O 38. 3x + 2y = 2 


3X; = 2%, = =1 6x + 4y = 14 
39. 2u+ v= 120 40. x, —2x,=0 
u + 2v = 120 6x, + 2x, =0 
41. 9x — 3y = -1 42. aa oa éx, = 0 
5x és zy = 3 4x, + x, =0 
eM yr xX +3 X= 1 
43. + = 44. = 1 
: 2 3 4 3 
x—2y=5 244 Ny = 12: 


45. 0.02x, — 0.05x, = —0.19 46. 0.05x, — 0.03x, = 0.21 
0.03x, + 0.04x, = 0.52 0.07x, + 0.02x, = 0.17 


47. x+y+z=6 48. x y z=2 
26> yr ZS 3 x+3y+2z=8 
3x —z=0 4x + y =4 
49. 3x, — 2x, + 4x, = 1 50. 5x, — 3x, + 2x; =3 
Ho Xo 2k 2x, + 4%, - 43 =7 
2h = Biko Ft 6hy = x, — 11x, + 4x, = 3 
51.0 2x, + x, - 3x%3= 4 52. x, +4x;= 13 
4x, + 2x, = 10 4x, —2x%,+ x= 7 
2x, + 3x, — 13x, 8 2x; = 2X3 — 1x, = — 19 
53. x— 3y+ 2z= 18 54. x, —2x,+5x,= 2 
5x — 15y + 10z = 18 3x, + 2x, —- x, = —2 


55. x Yeaeg w= 


56. x, + 3x,=4 
2X y= Xe = 0 
3x5 —2x,=1 

2X, — X_ + 4x, =5 


*y) In Exercises 57—64, use a computer software program or graphing 
IFM. utility to solve the system of linear equations. 


57. x, + 0.5x, + 0.33x, + 0.25x, = 1.1 
0.5x, + 0.33x, + 0.25x, + 0.21x, = 1.2 
0.33x, + 0.25x, + 0.2x, + 0.17xy = 1.3 
0.25x, + 0.2x, + 0.17x, + 0.14x, = 1.4 


The symbol (pM indicates that electronic data sets for these exercises are 


available at college.hmco.com/pic/larsonELA6e. These data sets are compatible 


with each of the following technologies: MATLAB, Mathematica, Maple, 


Derive, TI-83/TI-83 Plus, TI-84/TI-84 Plus, TI-86, TI-89, TI-92, and TI-92 Plus. 


58. O.lx — 2.5y + 1.22 —0.75w = 108 
2.4x + 1.5y — 1.82 + 0.25w = 81 
0.4x — 3.2y + 1.6z 14w = 148.8 
16x L.2y'= 3:22 0.6w = — 143.2 

59. 123.5x + 61.3y — 32.42 = —262.74 
54.7x — 45.6y + 98.22 = 197.4 
42.4x — 89.3y + 12.92 = 33.66 

60. 120.2x + 62.4y — 36.5z = 258.64 
56.8x — 42.8y + 27.32 = —71.44 

88.1x + 72.5y — 28.5z = 225.88 


A. - Se ah 2 oe BAP Lo a See ot Ves ee 
61. 3x, — 7X + 9X3 = G30 62. 4X, — 5X2 + 3X3 = 6 
2 4 Ba, ee ee 2 os eee | 
3% 9%, — 5%3 = 45 5%) 7 4X2 — 6%3 600 
Bo fade a. ee LSP Boe a eg dy Dee es, OL 
5%) — 9X2 F 3%3 = 150 4X ~ 5X2 7 5X3 = 100 
1 1 1 1 1 1 1 
63. sx —7y + oz -sw=l 64. gx tay — gz tswH= 1 
1 1 1 de ee A 1 1 LS 
7x + ey — 5+ qw=l ax — sy +5z-—qw=1 
1 1 i We see 1 i 1 de 
6x — sy + 4z— 3W= 1 ex + sy — 4ztaw= 1 
i 1 1 a 1 1 1 ee 
sx tay — 32+ w= 1 5x — gy +32 —- QW 1 


In Exercises 65—68, state why each system of equations must have 
at least one solution. Then solve the system and determine if it has 
exactly one solution or an infinite number of solutions. 


65. 4x + 3y + 17z = 0 66. 2x + 3y =0 
5x + 4y + 22z7=0 4x+3y- z=0 
4x + 2y + 19z =0 8x + 3y + 3z =0 

67. 5x+ S5y- z=0 68. 12x +5y+z= 
10x + Sy + 2z=0 12x + 4y -—z=0 

5x + 15y — 97 =0 


True or False? In Exercises 69 and 70, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, 
provide an example that shows the statement is not true in all cases 
or cite an appropriate statement from the text. 


69. (a) A system of one linear equation in two variables is always 
consistent. 
(b) A system of two linear equations in three variables is always 
consistent. 
(c) If a linear system is consistent, then it has an infinite 
number of solutions. 


70. (a) A system of linear equations can have exactly two 
solutions. 
(b) Two systems of linear equations are equivalent if they have 
the same solution set. 
(c) A system of three linear equations in two variables is always 
inconsistent. 


71. Find a system of two equations in two variables, x, and x,, that 
has the solution set given by the parametric representation 
x, = tandx, = 3t — 4, where ¢ is any real number. Then show 
that the solutions to your system can also be written as 
a Z 45 and x, = ¢. 

17373 Be 

72. Find a system of two equations in three variables, x,, x,, and x3, 
that has the solution set given by the parametric representation 
x, =t, x =s, and x,=3+5-1, 

where s and ¢ are any real numbers. Then show that the 

solutions to your system can also be written as 


x, =3+s8s-t, x, =s, and x, =t. 


In Exercises 73-76, solve the system of equations by letting 
A = 1/x, B = 1/y, and C = 1/z. 


3, 22a, iets, i 
x y x y 
144g 3 4_ 25 
x y x y 6 

% 241-2. 4 (i sees a 
xX y & x y Z 
x Zz x oy 
2h god a 1S arcig 2,1,3_ 0 
x y 2 x y Z 


In Exercises 77 and 78, solve the system of linear equations for 

x and y. 

77. (cos @)x + (sin #)y = 1 78. 
(—sin 6)x + (cos @)y = 0 


(cos #—)x + (sin Ay = 1 
(—sin @)x + (cos @™)y = 1 


In Exercises 79-84, determine the value(s) of k such that the 
system of linear equations has the indicated number of solutions. 


Section 1.1 


81. 


83. 


85. 


86. 


87. 


88. 


89. 
90. 
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Exactly one solution 82. No solution 


x+ky=0 xt+ky =2 

kx + y=0 kx + y=4 

No solution 84. Exactly one solution 

x+2y+kz=6 kx + 2ky + 3kz = 4k 

3x + 6y + 8z =4 x y z= 0 
2x- yt z= 1 


Determine the values of k such that the system of linear 
equations does not have a unique solution. 


x ytkz=3 
x+ky z=2 
kx y z=1 


Find values of a, b, and c such that the system of linear 
equations has (a) exactly one solution, (b) an infinite number 
of solutions, and (c) no solution. 


x + 5y z=0 
x+6y- z=0 
2x t+ay+bz=c 


Writing Consider the system of linear equations in x and y. 
axt+by=c, 


a,x + byy = Cy 


a,x + bsy = c3 
Describe the graphs of these three equations in the xy-plane 


when the system has (a) exactly one solution, (b) an infinite 
number of solutions, and (c) no solution. 


Writing Explain why the system of linear equations in Exercise 
87 must be consistent if the constant terms c,, c,, and c, are all 
zero. 


Show that if ax? + bx + c = O forall x, thena =b=c=0. 


Consider the system of linear equations in x and y. 
ax + by=e 
oxt+dy=f 


Under what conditions will the system have exactly one 
solution? 


79. An infinite number of 


solutions 
4x +ky = 
kx + y= 


6 
=3 


80. An infinite number of 


solutions 
kx + y= 4 
2x. = 3y = = 12 


In Exercises 91 and 92, sketch the lines determined by the system 
of linear equations. Then use Gaussian elimination to solve the 
system. At each step of the elimination process, sketch the 
corresponding lines. What do you observe about these lines? 


91. x—4y=-3 92. 


5x - 6y = 13 


2x = 3y = 7 
—4x + oy = —-14 


Gaussian Elimination and Gauss-Jordan Elimination 


Definition of a Matrix If m and n are positive integers, then an m x n matrix is a rectangular array 


A, 42 %3 ~~" Gin 
9; 490 Ag3 Aon, 
G43; 43o G33 °° * Az, m tows 
ant Ang Ang a Ginn 
ee 
n columns 


in which each entry, a; ip of the matrix is a number. An m x n matrix (read “m by n’’) has 
m rows (horizontal lines) and n columns (vertical lines). 


The entry a;; is located in the ith row and the jth column. The index j is called the row 
subscript because it identifies the row in which the entry lies, and the index j is called the 
column subscript because it identifies the column in which the entry lies. 

A matrix with m rows and n columns (an m x n matrix) is said to be of size m x n. If 
m =n, the matrix is called square of order n. For a square matrix, the entries a,,, a5, 
d33,. . . are called the main diagonal entries. 
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(a) Size: 1 x 1 (b) Size: 2 x 2 

0 0 

2 

2] lo | 
(c) Size: 1 x 4 (d) Size: 3 x 2 
e T 
[1 -3 0 3] 2 2 
—7 4 


One very common use of matrices is to represent systems of linear equations. The matrix 
derived from the coefficients and constant terms of a system of linear equations is called the 
augmented matrix of the system. The matrix containing only the coefficients of the system 
is called the coefficient matrix of the system. Here is an example. 


System Augmented Matrix Coefficient Matrix 
x—4y+3z= 5 1 -4 3 3 1 -4 3 
=x r3y— 2=-3 = 3 =] =3 =1 3 o=L 
2x ae 6 2 0 -4 6 2 0 -4 


REMARK: Use 0 to indicate coefficients of zero. The coefficient of y in the third equation 
is zero, so a O takes its place in the matrix. Also note the fourth column of constant terms 
in the augmented matrix. 


When forming either the coefficient matrix or the augmented matrix of a system, you 
should begin by aligning the variables in the equations vertically. 


Given System Align Variables Augmented Matrix 
x, +3xy,= 9 x, + 3x, = 9 1 3 0 9 
—x, + 4x, = —2 —x, + 4x, = -2 0-1 4 -2 
x, —- 5x,= O xy —53x,= 0 1 0 —5 0 


Elementary Row Operations 


In the previous section you studied three operations that can be used on a system of linear 
equations to produce equivalent systems. 


1. Interchange two equations. 
2. Multiply an equation by a nonzero constant. 
3. Add a multiple of an equation to another equation. 


Elementary Row Operations 


In matrix terminology these three operations correspond to elementary row operations. 
An elementary row operation on an augmented matrix produces a new augmented 
matrix corresponding to a new (but equivalent) system of linear equations. Two matrices are 
said to be row-equivalent if one can be obtained from the other by a finite sequence of 
elementary row operations. 


Interchange the first and second rows. 


Original Matrix New Row-Equivalent Matrix Notation 
0 1 3 4 =] 2 0 3 
-1 2 0 3 0 1 3 4 ROR, 
2 =3 4 1 2 =3 4 1 
Multiply the first row by , to produce a new first row. 
Original Matrix New Row-Equivalent Matrix Notation 
2-4 6 -2 1-2 3 -1 QR, >R, 
1 oh O38 0 1 3. =3 0 
2 =2 1 2 > =2 1 2 
Add — 2 times the first row to the third row to produce a new third row. 
Original Matrix New Row-Equivalent Matrix Notation 
1 2 -4 3 1 2 —-4 3 
0 3 2, =] 0 3. 2, oil 
2 if 2 =2 0: -=3 I3° =8 R, + (—2)R, >R, 


REMARK: Notice in Example 2(c) that adding —2 times row | to row 3 does not change 
row I. 


EXAMPLE 3 


Using Elementary Row Operations to Solve a System 


Linear System 
x—2y+3z= 9 
=x + 3y =-4 
2x — 5y + 5z= 17 


Add the first equation to the second 
equation. 


x—-—2y+3z= 9 
y + 3z ) 
2x — Sy +5z= 17 


Add —2 times the first equation to the 
third equation. 
x—-2y+3z= 9 
y + 3z 
= - z= —]1 


Add the second equation to the third 
equation. 


x — 2y+ 3z=9 
y+3z=5 
2z=4 


Associated Augmented Matrix 
1 =2 3 9 
= 3 0 -4 
2 =) 5 17 
Add the first row to the second row to 
produce a new second row. 
lt =2 3 9 
0 1 3 5 
2 = 5 17 
Add —2 times the first row to the third 
row to produce a new third row. 
1 -2 3 9 
0 1 S) 5 
OQ. = 9) cS Sell 


R, + R,>R, 


Add the second row to the third row to 
produce a new third row. 


1 =2 3 9 


R,+ R,>R, 


R, + (—2)R, > R; 
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Definition of 
Row-Echelon Form 
of a Matrix 


Multiply the third equation by i. Multiply the third row by 5 to produce 
a new third row. 
x — 2y + 3z=9 1. =2 3 9 
yt3z=5 0 1 3 5 
z= 2 0 0 1 2 (3)R, > Rs 


Now you can use back-substitution to find the solution, as in Example 6 in Section 1.1. The 
solution is x = 1, y = —1, and z = 2. 


The last matrix in Example 3 is said to be in row-echelon form. The term echelon 
refers to the stair-step pattern formed by the nonzero elements of the matrix. To be in 
row-echelon form, a matrix must have the properties listed below. 


A matrix in row-echelon form has the following properties. 


1. All rows consisting entirely of zeros occur at the bottom of the matrix. 

2. For each row that does not consist entirely of zeros, the first nonzero entry is 1 (called 
a leading 1). 

3. For two successive (nonzero) rows, the leading | in the higher row is farther to the left 
than the leading | in the lower row. 


REMARK: A matrix in row-echelon form is in reduced row-echelon form if every 
column that has a leading | has zeros in every position above and below its leading 1. 


The matrices below are in row-echelon form. 


1 2-1 4 "ns 
@]O 1 0 3 (>) i 3 
0 0 1 -2 oO 0 0 0 
1-5 2 -1 3 1 0 0 -1 
Oana ~2 \ | 
(c) (d) 
OueOuend 4 o o 1 
0 0 0 1 O00) 


The matrices shown in parts (b) and (d) are in reduced row-echelon form. The matrices 
listed below are not in row-echelon form. 

1 2 =3 4 1 2 =! 2 
(e) | 0 D i =] (f) | 0 0 0 0 

0 0) 1 -3 0 1 2 —4 


Gaussian Elimination with 
Back-Substitution 


EXAMPLE 5 


It can be shown that every matrix is row-equivalent to a matrix in row-echelon form. 
For instance, in Example 4 you could change the matrix in part (e) to row-echelon form by 
multiplying the second row in the matrix by 5. 

The method of using Gaussian elimination with back-substitution to solve a system is as 
follows. 


REMARK: For keystrokes and programming syntax regarding specific graphing utilities 
and computer software programs involving Example 4(f), please visit college.hmco.com/ 
pic/larsonELA6e. Similar exercises and projects are also available on the website. 


1. Write the augmented matrix of the system of linear equations. 

2. Use elementary row operations to rewrite the augmented matrix in row-echelon form. 

3. Write the system of linear equations corresponding to the matrix in row-echelon form, 
and use back-substitution to find the solution. 


Gaussian elimination with back-substitution works well as an algorithmic method for 
solving systems of linear equations. For this algorithm, the order in which the elementary 
row operations are performed is important. Move from left to right by columns, changing 
all entries directly below the leading 1’s to zeros. 


Gaussian Elimination with Back-Substitution 


Solve the system. 


Xy + xX,-2x%,= -3 
x, 2X5 = 2X, = 2 
2x, + 4x, + x, -3x,= —2 
xj = 4x3 = 7x, a= = 12 


The augmented matrix for this system is 
0 1 lL, 2, 3 
1 2 =1 0 2 
2 4 1 -3 -27 
1 4 7 1 -19 


Obtain a leading 1 in the upper left corner and zeros elsewhere in the first column. 


1 2 -l 0 2 ——"_ The firsttworows ROR, 
0 1 172 -3 <— are interchanged. 
2 4 =3 =2 
1 4 7 1 =19 
1 2 =] 0 2 ; P 
Adding —2 times the first 
0 1 —2 —3 row to the third row 
0 0 3 3 -6 <== produces anew third row. R; + (—2)R,>R; 
1 4 7 1 -=19 


1 2 =] 0 2 
0 1 1 -—2 -3 
Adding —1 times the first 
0 0 ge Sa 0 row to the fourth row 
0 6 6 1 -21 <= produces a new fourth row. Ry, + (—1)R,>R, 


Now that the first column is in the desired form, you should change the second column as 
shown below. 

1 2 =] 0 2 
0 1 1 =2. =3 
0 


Adding 6 times the second 
0 3. -3 —-6 row to the fourth row 
0 0 0 -13 —39 <— produces anew fourth row. R, + (6)R,>R, 


To write the third column in proper form, multiply the third row by 7 


1 2 =] 0 2 
0 1 lL. =2. =3 Multiplying the third row by i 
0 0 im —-1 —2 <= produces a new third row. (3) RR, 


0 0 We—-13 —39 


Similarly, to write the fourth column in proper form, you should multiply the fourth row 
by —+. 


1 2 -1 0) 2 

0 1 L° =2: =3 

0 0 mi -2 Multiplying the fourth row by -4 

0 0 0 1 3 <= produces a new fourth row. (-4)R, OR, 


The matrix is now in row-echelon form, and the corresponding system of linear equations 
is as shown below. 


X, + 2x5 — x4 = 2 
X_ + x5 — 2x, = —3 
xX,- X= 2 

x= 3 


Using back-substitution, you can determine that the solution is 


4 = =1, x, = 2, x, = 1, x4 = 3. 


When solving a system of linear equations, remember that it is possible for the system 
to have no solution. If during the elimination process you obtain a row with all zeros except 
for the last entry, it is unnecessary to continue the elimination process. You can simply 
conclude that the system is inconsistent and has no solution. 


A System with No Solution 


Zero ws 
pe equal 


X,— xX, +2x,=4 
x + x,=6 
2x, — 3x, + 5x, = 4 
3x, + 2x, - x, =1 


1 - 2 
fal 0 1 
2 -3 5 


3 2, =I 


=e BW fF 


Apply Gaussian elimination to the augmented matrix. 


=1 2 4 
J =] 2 

> 4 
2 = 1 


R, + (-1)R, > R, 


wn oO Fe 
| 
w 


=] 2 4 
1. =1 2 
R, + (-2)R, > R; 


eae 2 2 = 
| 
= 
_ 
| 
AK 


| 
No 
| 
Se 
| 
me 
| SENS ee | 


R, + (-3)R,; OR, 


ooo KF 
S 
@.. - 
& 
+ 
a 
n 
J 
Es) 
we 


Note that the third row of this matrix consists of all zeros except for the last entry. This 
means that the original system of linear equations is inconsistent. You can see why this is 
true by converting back to a system of linear equations. 


Discovery 


EXAMPLE 7 


X,)—- %+2x,= 4 
2 
—_ JAN 


3xy — Tx, = —11 


—" 
II 


Because the third “equation” is a false statement, the system has no solution. 


Consider the system of linear equations. 
2X, + 3X, + 5x, =0 
5X, + 6X, — 17x, = 0 
IX, — 4X, + 3x, = 0 


Without doing any row operations, explain why this system Is consistent. 
The system below has more variables than equations. Why does it have an infinite number of 


solutions? 


2X, + 3X, + 5X, + 2X, = 0 
5X, + 6X, — 17%, 3x, = 0 
1X, — 4X, + 3X, + 13X, = 0 


Gauss-Jordan Elimination 


SOLUTION 


Use Gauss-Jordan elimination to solve the system. 
x—-2y+3z= 9 
=xr Sy =—-4 
2x —5y+5z= 17 
In Example 3, Gaussian elimination was used to obtain the row-echelon form 
a —2 3 9 
0 1 3 3: |. 
0 0 1 2 
Now, rather than using back-substitution, apply elementary row operations until you obtain 


a matrix in reduced row-echelon form. To do this, you must produce zeros above each of 
the leading 1’s, as follows. 
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1 0 9 19 R, + Q)R,R, 
0 1 3 5 
0 0 1 2 


0 1 Om —1 R, + (-3)R,;>R, 


1 0 0 1 R, + (-9)R,;>R, 
elk 
0 0 1 2 


S 
= 
S 


Now, converting back to a system of linear equations, you have 
x = | 
y = =I 
z= 2. 


The Gaussian and Gauss-Jordan elimination procedures employ an algorithmic approach 
easily adapted to computer use. These elimination procedures, however, make no effort to 
avoid fractional coefficients. For instance, if the system in Example 7 had been listed as 

2x —S5y+5z= 17 
K— Dy + 3z 9 
= Sy =-—4 


both procedures would have required multiplying the first row by om which would have 
introduced fractions in the first row. For hand computations, fractions can sometimes be 
avoided by judiciously choosing the order in which elementary row operations are applied. 


REMARK: No matter which order you use, the reduced row-echelon form will be the same. 


The next example demonstrates how Gauss-Jordan elimination can be used to solve a 
system with an infinite number of solutions. 


EXAMPLE 8|_ A System with an Infinite Number of Solutions 


Solve the system of linear equations. 


2x, + 4x, — 2x, = 0 
3x, + 5x, =1 


SOLUTION The augmented matrix of the system of linear equations is 


F 4 -2 "| 
3 5 0 1] 
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Systems of Linear Equations 


Using a graphing utility, a computer software program, or Gauss-Jordan elimination, you 
can verify that the reduced row-echelon form of the matrix is 


I 0 5 | 
0 lt =a = 


The corresponding system of equations is 
xy +5x,= 2 
Xo = 3X5.= = 1. 
Now, using the parameter ¢ to represent the nonleading variable x;, you have 


ApH 2S Ob xy = = 1+ 3t, x3 =, where f is any real number. 


REMARK: Note that in Example 8 an arbitrary parameter was assigned to the nonleading 
variable x,. You subsequently solved for the leading variables x, and x, as functions of ¢. 


Homogeneous Systems of Linear Equations 


As the final topic of this section, you will look at systems of linear equations in which 
each of the constant terms is zero. We call such systems homogeneous. For example, a 
homogeneous system of m equations in n variables has the form 


AX, + AX, + Ay3X, + + Ay, xX, = 
AX, + AgaXy + An3X, + °° + + Ay, X, = 0 
A3)X) + AzX_ + 33%, + °° + + ag,X, a 
AmiX + An2*2 + An3X3 ae iva? QinnXn = 0. 


It is easy to see that a homogeneous system must have at least one solution. Specifically, 
if all variables in a homogeneous system have the value zero, then each of the equations 
must be satisfied. Such a solution is called trivial (or obvious). For instance, a 
homogeneous system of three equations in the three variables x,, x,, and x; must have 
x, = 0, x, = 0, and x, = 0 as a trivial solution. 


EXAMPLE 9| Solving a Homogeneous System of Linear Equations 


Solve the system of linear equations. 
XxX, — xX, + 3x, =0 


2x, + x, + 3x, =0 
Applying Gauss-Jordan elimination to the augmented matrix 
|; =] 3 | 
2 1 3 0 
yields the matrix shown below. 


[. —l 3 | 
0 3. S38 0 R, + (-2)R, > R, 


im —1 3 | 
0 1-1 0 (3)R,>R, 
[. 0 2 | R,+R,>R, 
0 i —1 0 
The system of equations corresponding to this matrix is 
Xi + 2x, = 0 
X_— Xz = 0. 
Using the parameter t = x3, the solution set is 
x, = —2t, xX, =, x3; =, tis any real number. 


This system of equations has an infinite number of solutions, one of which is the trivial 
solution (given by ¢ = 0). 


THEOREM 1.1 
The Number of Solutions of 
a Homogeneous System 


Every homogeneous system of linear equations is consistent. Moreover, if the system has 
fewer equations than variables, then it must have an infinite number of solutions. 


In Exercises 1—8, determine the size of the matrix. 


a a Oy 23] a 
A ; > e1ah? asl 0 2 4 
KS 


3.|_2 Te | 2x4 4[1 2 3 04 


5.[1 2 3 4 —10]4"5 6. [-1] 181 


8 6 4 1 3 1 
2 1-7 4 1x5 

"4 tat 2 if a ard 
1-1 2 0 0 -2 


In Exercises 9-14, determine whether the matrix is in row-echelon 
form. If it is, determine whether it is also in reduced row-echelon 


form. ).9 wW echelon torm 


0 0 O 
9/0 @ 1 2 
0 0 Oo 
row echelon 
0 1 3 
1./o0 [f-1] 1° 4 
0 Z 0 
0 0 0 0 reduced 
13./0 0 oO ff} Oo row 
oe wR chelon 


In Exercises 15—22, find the solution set of the system of linear 


0 1 2 0 1 ) 


ms] by the augmented matrix 
= 0) =2 
15. Io , | 16. F 4 G23) 


1-1 0 3 G--) 1 2 1 +0 

0 1-2 1 18./0 O 1 -1/#+ 

CC t t =7 aE] 0 O 

2 1-1 3 2 1 1 O 
19/1 -1 1 O 20./1 -2 1-2 

0 1 2 41 1 0 1 0 

1 2 0 1 4 1 2 0 1 3 

0 1 2 1 3 0 1 3 0 41 
Aly 9 1 2 4 cal |r a oe 

oo 0 1 «4 0 0 0 0 2 


ant oR, 8H" ba 
1 2[#]_,[t2 7 
aye 
23. x+2y= 
2x + y=8lia3 
5, -x+2y=15 ¥ 
A215 
2x — 4y = 3l00 0 
27. @Bx + By = —22)35 2 
w+ m= 49 ‘| 
4ax-By= 32 
29, x, = 3xg = 2. 
Shy eg 2S 3 
2X, + 2%) F x= 4 
31. x, + x, — 5x3 = 3 
x, =2x, = 1 
2X1 — Xq x3 = 0 
33. 4x + 12y — 7z — 20w = 22 
3x 9y — 5z — 28w = 30 
35. 3x + 3y + 12z 6 
x y 4z 2 
2x + 5y + 20z = 10 
x + 2y 8 = 4 
36. 2x y z+ 2w 6 
3x + 4y +w= 1 
x + 5y + 2z + 6w 3 
5x+2y- z- w= 3 


In Exercises 37—42, use a computer software program or graphing 


—f, 16 16 obit 
2% 16 00 O]  sobtions 
24. 2x+b6y= 16 
—2x — 6y = — 16 hk, Re 
oe = ipa = 2-1-0 
art2y= 16h * Mone 
y 4 
28. x+2y=0 
x+ y=6 
3x —2y =8 
30. 2x, — x, + 3x, = 24 
2x, —- x, = 14 
7x, — 5X5 = 6 
32. 2x, + 3x3 3 
4x, — 3x, + 7x, = 5 
8x, — 9x, + 15x; = 10 
34, xt+2y+ z= 8 
3x — 6y — 3z 21 


utility to solve the system of linear equations. 


37. 


38. 


Hy = 285 Oxy = 3X, = 23.6 
x, + 4x, — 7x, — 2x, = 45.7 
3x, — 5x, + 7x, + 4x, = 29.9 
23.4x — 45.8y + 43.7z = 87.2 
86.4x + 12.3y — 56.9z = 14.5 
93.6x — 50.7y + 12.6z = 44.4 
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39. x, Ny. F 2Xq 1 2X4 6x5 6 (d) If A is the coefficient matrix of a homogeneous system of 
3x, — 2x, + 4x, + 4x, 4+ 12x, = 14 linear equations, find the value(s) of k such that the system 
X> x, 4 3x, = —3 is consistent. 
2x, — 2x, + 4x, + 5x, + 15x5 = 10 2 =! , 
2x, — 2x, + 4x, + 4x, + 13x, = 13 48. Consider the matrix A = | —4 2 k}. 
40. x, + x, — 2x, + 3x, + 2x5 = 9 —_ 7 © 
3x, + 3x, xX X4 x, = 5 (a) If A is the augmented matrix of a system of linear 
: : equations, determine the number of equations and the 
2X, + 2x, x3 X= 2K5.= 1 ; 
number of variables. 
4x, + 4x, + — = 4 : : : 
“a ne oh (b) If A is the augmented matrix of a system of linear 
8x, + 5x2 — 2x5 X4 + 2x5 = 3 equations, find the value(s) of k such that the system is 
41. 4x, — 3x, X X4 + 2x5 X= 8 consistent. 

x — 2x, x3 — 3X, X3—4x,= 4 (c) If A is the coefficient matrix of a homogeneous system of 
2x, X_ — 3x5 X4— 2x5 + 5xe= 2 linear equations, determine the number of equations and the 
2x, + 3x, -— % Xy— Xs + 2X6 = —7 number of variables. 

a 8 Bs ay = OKs 7 ? (d) If A is the coefficient matrix of a homogeneous system of 
5x — 4x5 %3 X4 + 4xs + 5X, 9 linear equations, find the value(s) of k such that the system 

42. x, + 2x, — 2x; + 2x, x; + 3xe= 0 is consistent. 
2x, X_ + 3x, X4 — 3x5 + 2x, = 17 : : : 
In Exercises 49 and 50, find values of a, b, and c (if possible) such 
X, + 3x5. = 2X5 X= 2Ks = 3X6 =) . . i : 
3 ; _ that the system of linear equations has (a) a unique solution, (b) no 
x, — 2x5 Xy X4 + 3x5 — 2X6 1 iti d ents ip areotni 
x, — 2, x, + 2x, — 2x, + 3x, = 10 solution, and (c) an infinite number of solutions. 
Xe Ks x3 + 3x4 — 2x5 X= Il 49, x+ y =2 50. x+ y =0 
In Exercises 43—46, solve the homogeneous linear system corre- eS ya e=0 
sponding to the coefficient matrix provided. x Te SL x ag -=0 
1 0 0 ax + by + cz =0 ax + by + cz =0 
1 0 0 0 
43. | 0 ! l 44. 0 1 1 0 51. The system below has one solution: x = 1, y = —1, andz = 2. 
0 0 0 
4x — 2y + 5z = 16 Equation 1 
1 0 0 1 0 0 0 x+y = 0 Equation 2 
aS: 0 0 | iu a6. 0 0 0 =x = By + 27= 6 Equation 3 
0 0 0 0 0 0 0 


Solve the systems provided by (a) Equations | and 2, 
dr Cention hominid = | 1 k | (b) Equations 1 and 3, and (c) Equations 2 and 3. (d) How many 
= 4+ 1 solutions does each of these systems have? 


(a) If A is the augmented matrix of a system of linear 52. Assume the system below has a unique solution. 
equations, determine the number of equations and the ; 
number of variables. AyXy + AygXp TF Aysks = by Haaren t 

(b) If A is the augmented matrix of a system of linear Ay\X1 + AyXy + Az3X3 = dy Equation 2 
equations, find the value(s) of k such that the system is G31 X1 + AyX + A43X3 = dD, Equation 3 


consistent. . . 
Does the system composed of Equations | and 2 have a unique 


(c) If A is the coefficient matrix of a homogeneous system of solution, no solution, or an infinite number of solutions? 


linear equations, determine the number of equations and the 
number of variables. 


In Exercises 53 and 54, find the unique reduced row-echelon matrix 
that is row-equivalent to the matrix provided. 


, = i 2 3 

53. 
3 EF | 54/4 5 6 
7 8 9 


True or False? In Exercises 57 and 58, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, 
provide an example that shows the statement is not true in all cases 
or cite an appropriate statement from the text. 

57, (a) A 6 x 3 matrix has six rows. 


(b) Every matrix is row-equivalent to a matrix in row-echelon 
form. 


(c) If the row-echelon form of the augmented matrix of a 
system of linear equations contains the row [1 0 0 0 0], 
then the original system is inconsistent. 


(d) A homogeneous system of four linear equations in six 
variables has an infinite number of solutions. 


58. (a) A 4 x 7 matrix has four columns. 
(b) Every matrix has a unique reduced row-echelon form. 


(c) A homogeneous system of four linear equations in four 
variables is always consistent. 


(d) Multiplying a row of a matrix by a constant is one of the 
elementary row operations. 


In Exercises 59 and 60, determine conditions on a, b, c, and d such 
that the matrix 


a 


will be row-equivalent to the given matrix. 


1 0 1 0 
59. . 
E | E 0 


In Exercises 61 and 62, find all values of A (the Greek letter lambda) 
such that the homogeneous system of linear equations will have 
nontrivial solutions. 


61. (A — 2)x + y=0 
x+(A—2)y =0 


62. (A — 1)x 4 


xc 


66. 


b 
Consider the 2 x 2 matrix b | 


t+ 2y =0 
t Ay = 0 


d 


Perform the sequence of row operations. -R,+ R, ad R 


(a) Add (— 1) times the second row to the first row. 


(b) Add 1 times the first row to the second row. R,+ R.7 R, 


(c) Add (—1) times the second row to the first row. 
(d) Multiply the first row by (— 1). “Ra*R, R, 


c 


“¢ 
a 


q 


-d 
b 


c 
+ |; 


The augmented matrix represents a system of linear equations 
that has been reduced using Gauss-Jordan elimination. Write 
a system of equations with nonzero coefficients that is 
represented by the reduced matrix. 


1 


0 


3 


0 


=2 


1 
0 


y+32-2 
y+hz@ = 1 


0-0 


a-C b- 


b 


| 


ps Yn) 


(X, Ya) 


> xX 


(x1, 9) 


Polynomial Curve Fitting 


Figure 1.4 


EXAMPLE 1 
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1.3 | Applications of Systems of Linear Equations 


Systems of linear equations arise in a wide variety of applications and are one of the 
central themes in linear algebra. In this section you will look at two such applications, and 
you will see many more in subsequent chapters. The first application shows how to fit a 
polynomial function to a set of data points in the plane. The second application focuses on 
networks and Kirchhoff’s Laws for electricity. 


Polynomial Curve Fitting 


Suppose a collection of data is represented by n points in the xy-plane, 
(x1, y1)> (x5, Yo), totes Ca yn) 

and you are asked to find a polynomial function of degree n — 1 
P(x) = dy + ayx + agx? +--+ +a, 4x"! 


whose graph passes through the specified points. This procedure is called polynomial 
curve fitting. If all x-coordinates of the points are distinct, then there is precisely one 
polynomial function of degree n — | (or less) that fits the m points, as shown in Figure 1.4. 

To solve for the n coefficients of p(x), substitute each of the n points into the 


polynomial function and obtain n linear equations in n variables dp, a), dy,. . -, 4,4. 
2 oe 8 n-1 — 
Ag + AX, + Agxp + + A, 1X] yy 
2 SAS We n-l = 
Ag + AyXy + AXy + + a, 4X3 oy) 
2 ae @ n-1 — 
ao + aX, AX; a + Gy —1Xn Yn 


This procedure is demonstrated with a second-degree polynomial in Example 1. 


Polynomial Curve Fitting 


SOLUTION 


lay 


Simulation 

Explore this concept further with an 
electronic simulation available on 
the website college.hmco.con/ 
pic/larsonELA6e. 


Determine the polynomial p(x) = ay) + a,x + a,x? whose graph passes through the points 
(1, 4), (2, 0), and (3, 12). 


Substituting x = 1, 2, and 3 into p(x) and equating the results to the respective y-values 
produces the system of linear equations in the variables a), a,, and a, shown below. 


pl) = a, + a) + a,(1)? =a, + a, + a= 4 
p(2) = ay + a,(2) + a (2)? = ay + 2a, + 4a, = 0 
p(3) = ay + a,(3) + a,(3)? = ay + 3a, + 9a, = 12 


The solution of this system is a) = 24, a, = —28, and a, = 8, so the polynomial 
function is 


p(x) = 24 — 28x + 8x?. 


30 


Chapter 1 Systems of Linear Equations 


EXAMPLE 2 


The graph of p is shown in Figure 1.5. 


(2, 10) 


(3, 12) 


t > Xx =e, 
4 
p(x) = 24 — 28x + 8x2 p(x) = (24 — 30x + 101x2 + 18x3 —1 7x4) 
Figure 1.5 Figure 1.6 
Polynomial Curve Fitting 


SOLUTION 


Find a polynomial that fits the points (— 2, 3), (—1, 5), (0, 1), (1, 4), and (2, 10). 
Because you are provided with five points, choose a fourth-degree polynomial function 
P(x) = dy + ayx + ayx? + ayx? + ayxt. 


Substituting the given points into p(x) produces the system of linear equations listed below. 


dy — 2a, + 4a, — 8a, + 16a, = 3 
Ag - a+ 4 - G+ a= 5 
do = | 


aot a, + at at a= 4 
dy + 2a, + 4a, + 8a, + 16a, = 10 
The solution of these equations is 


24 _ _ 30 _ 101 _ 18 7 
a — 1, a; ~ ~ 94> ay ~ “94> a3 — 24> a4 24 


which means the polynomial function is 


30 101 5 18 3 174 
P(x) = 1 — ggx + ggx? + agx? — pgx 


= 34 (24 — 30x + 101x? + 18x3 — 17x4). 


The graph of p is shown in Figure 1.6. 


EXAMPLE 3 


Section 1.3 Applications of Systems of Linear Equations 31 


The system of linear equations in Example 2 is relatively easy to solve because the 
x-values are small. With a set of points with large x-values, it is usually best to translate the 
values before attempting the curve-fitting procedure. This approach is demonstrated in the 
next example. 


Translating Large x-Values Before Curve Fitting 


SOLUTION 


EXAMPLE 4 


Find a polynomial that fits the points 


(1,9) (Xp, ¥2) (x3, ¥3) (x4, Ya) (x5, Ys) 
ii a a. ii a Cc a a | os 


(2006, 3), (2007, 5), (2008, 1), (2009, 4), (2010, 10). 


Because the given x-values are large, use the translation z = x — 2008 to obtain 
(2,9) ore 2) RNs) tin ya) (ays) 
c ) SSS 


"Gee (1, 4) (2, 10). 


— = c 1 
(=2,3); (=1,5), 

This is the same set of points as in Example 2. So, the polynomial that fits these points is 
p(z) = 4(24 — 30z + 101z2 + 1823 — 1724) 


5, 101 3 7 
=l- + ye +a os. 


Letting z = x — 2008, you have 
p(x) = 1 — 3(« — 2008) + E(x — 2008)? + 3(x — 2008)? — (x — 2008)*. 


An Application of Curve Fitting 


SOLUTION 


Find a polynomial that relates the periods of the first three planets to their mean distances 
from the sun, as shown in Table 1.1. Then test the accuracy of the fit by using the polyno- 
mial to calculate the period of Mars. (Distance is measured in astronomical units, and 
period is measured in years.) (Source: CRC Handbook of Chemistry and Physics) 


TABLE 1.1 


Planet Mercury Venus Earth Mars Jupiter Saturn 


Mean Distance 0.387 0.723 1.0 1.523 5.203 9.541 


Period 0.241 0.615 1.0 1.881 11.861 29.457 


Begin by fitting a quadratic polynomial function 
P(x) = dy + ayx + ayx? 


to the points (0.387, 0.241), (0.723, 0.615), and (1, 1). The system of linear equations 
obtained by substituting these points into p(x) is 


dy + 0.387a, + (0.387)?a, = 0.241 
dy + 0.723a, + (0.723)?a, = 0.615 
dy + a, + a, = 1. 
The approximate solution of the system is 
dy ~ — 0.0634, a, ~ 0.6119, ad, ~ 0.4515 
which means that the polynomial function can be approximated by 
p(x) = —0.0634 + 0.6119x + 0.4515x?. 
Using p(x) to evaluate the period of Mars produces 
p(1.523) ~ 1.916 years. 


This estimate is compared graphically with the actual period of Mars in Figure 1.7. Note 
that the actual period (from Table 1.1) is 1.881 years. 


An important lesson may be learned from the application shown in Example 4: The 
polynomial that fits the given data points is not necessarily an accurate model for the 
relationship between x and y for x-values other than those corresponding to the given 
points. Generally, the farther the additional points are from the given points, the worse the 
fit. For instance, in Example 4 the mean distance of Jupiter is 5.203. The corresponding 
polynomial approximation for the period is 15.343 years—a poor estimate of Jupiter’s 
actual period of 11.861 years. 

The problem of curve fitting can be difficult. Types of functions other than 
polynomial functions often provide better fits. To see this, look again at the curve-fitting 
problem in Example 4. Taking the natural logarithms of the distances and periods of the 
first six planets produces the results shown in Table 1.2 and Figure 1.8. 


TABLE 1.2 

Planet Mercury Venus Earth Mars Jupiter Saturn 
Mean Distance (x) 0.387 0.723 1.0 1.523 5.203 9.541 
Natural Log of Mean —0.949 — 0.324 0.0 0.421 1.649 2.256 
Period (y) 0.241 0.615 1.0 1.881 11.861 29.457 
Natural Log of Period | —1.423 — 0.486 0.0 0.632 2.473 3.383 


Now, fitting a polynomial to the logarithms of the distances and periods produces the 
linear relationship between In x and In y shown below. 


Iny = 3inx 


From this equation it follows that y = x3/?, or y2 = x°. 


EXAMPLE 5 
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In other words, the square of the period (in years) of each planet is equal to the cube of its 
mean distance (in astronomical units) from the sun. This relationship was first discovered 
by Johannes Kepler in 1619. 


Network Analysis 


Networks composed of branches and junctions are used as models in many diverse fields 
such as economics, traffic analysis, and electrical engineering. 

In such models it is assumed that the total flow into a junction is equal to the total flow 
out of the junction. For example, because the junction shown in Figure 1.9 has 25 units 
flowing into it, there must be 25 units flowing out of it. This is represented by the linear 
equation 

x, + x, = 25. 

Because each junction in a network gives rise to a linear equation, you can analyze 
the flow through a network composed of several junctions by solving a system of linear 
equations. This procedure is illustrated in Example 5. 

x] 


25 


x9 


Figure 1.9 


Analysis of a Network 


Set up a system of linear equations to represent the network shown in Figure 1.10, and solve 
the system. 


Q 


Figure 1.10 
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SOLUTION Each of the network’s five junctions gives rise to a linear equation, as shown below. 


XxX, +X, = 20 Junction 1 
Xz — X4 = —20 Junction 2 

X_ + X5 = 20 Junction 3 

x, =x, = —10 Junction 4 
=x, + x2 = —10 Junction 5 


The augmented matrix for this system is 


1 1 0 0 0 20 
0 0 1 = 0 —20 
0 1 1 0 O 20 |}. 
1 0 0 0 —1 —-10 
0 0 0 -Il 1 —10 


Gauss-Jordan elimination produces the matrix 


1 0 0 0 -—1 —-10 
0 1 0 0 1 30 
0 0 1 0 —1 —10}. 
0 0 0 1 -1 10 
0 0 0 0 0 0 


From the matrix above, you can see that 

xX — Xe = 10, x5 +x5,=30, x3 -—x%,= 10, and x,—x, = 10. 
Letting f = x5, you have 

x, =t= 10, xX, = —t + 30, te = t= 10, x,=t+ 10, x= 4 


where f¢ is a real number, so this system has an infinite number of solutions. 


In Example 5, suppose you could control the amount of flow along the branch 
labeled x;. Using the solution from Example 5, you could then control the flow represented 
by each of the other variables. For instance, letting t = 10 would reduce the flow of x, and 
xX, to zero, as shown in Figure 1.11. Similarly, letting t = 20 would produce the network 
shown in Figure 1.12. 
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Figure 1.11 


10y 130 


@) - () 


Figure 1.12 


You can see how the type of network analysis demonstrated in Example 5 could be used 
in problems dealing with the flow of traffic through the streets of a city or the flow of water 
through an irrigation system. 

An electrical network is another type of network where analysis is commonly applied. 
An analysis of such a system uses two properties of electrical networks known as 
Kirchhoff’s Laws. 


1. All the current flowing into a junction must flow out of it. 
2. The sum of the products /R (J is current and R is resistance) around a closed path is equal 
to the total voltage in the path. 


In an electrical network, current is measured in amps, resistance in ohms, and the 
product of current and resistance in volts. Batteries are represented by the symbol ==, 
The larger vertical bar denotes where the current flows out of the terminal. Resistance is 
denoted by the symbol “VV\- . The direction of the current is indicated by an arrow in 
the branch. 


REMARK: A closed path is a sequence of branches such that the beginning point of the 
first branch coincides with the end point of the last branch. 
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EXAMPLE 6| Analysis of an Electrical Network 


Determine the currents /,, /,, and /, for the electrical network shown in Figure 1.13. 


7 volts 


8 volts 
Figure 1.13 
SOLUTION Applying Kirchhoff’s first law to either junction produces 
L+h=L Junction 1 or Junction 2 
and applying Kirchhoff’s second law to the two paths produces 
RI, + RL = 34, + 24, =7 Path 1 
Rj, + Rl, = 21, + 4h, = 8. Path 2 
So, you have the following system of three linear equations in the variables 7,, /,, and 1. 
,- + L=0 
31, + 21, =7 
21, + 4h, = 8 


Applying Gauss-Jordan elimination to the augmented matrix 


0 1 0 2 
0 0 1 1 


which means J, = | amp, J, = 2 amps, and J, = | amp. 
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EXAMPLE 7| _ Analysis of an Electrical Network 


Determine the currents J,, J,, J,, I,, 1;, and J, for the electrical network shown in 
Figure 1.14. 


q 10 volts 


Figure 1.14 


SOLUTION Applying Kirchhoff’s first law to the four junctions produces 


L+h=L Junction 1 
Lt+h=L Junction 2 
IL,+k =I, Junction 3 
+g =I, Junction 4 


and applying Kirchhoff’s second law to the three paths produces 


21, + 41, = 10 Path 1 
4I, + 1, + 21, + 21, =17 Path 2 
21, + 41, = 14. Path 3 
You now have the following system of seven linear equations in the variables J,, 1,, J,, L,, 
I,, and I,. 
l= 5+ 4h, = 0 
= £ + I, = 0 
I, —- 1I,+ I= 0 
I,- I,+ I,= 0 
21, + 41, = 10 
4], + 1, + 21, + 21, =17 


2I, + 41, = 14 
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Using Gauss-Jordan elimination, a graphing utility, or a computer software program, you 
can solve this system to obtain 


Li=2, 


I,=3, and I, =2 


meaning J, = | amp, J, = 2 amps, J, = 1 amp, J, = | amp, J; = 3 amps, and J, = 2 amps. 


SAN Ree Exercises 


Polynomial Curve Fitting 


In Exercises 1-6, (a) determine the polynomial function whose 
graph passes through the given points, and (b) sketch the graph of 
the polynomial function, showing the given points. 


1. 


10. 


11. 


12. 


3. (2, 4), (3, 6), (5, 10) 
5. 
6. (2005, 150), (2006, 180), (2007, 240), (2008, 360) 


(2, 5), (3, 2), (4, 5) 2. (2, 4), (3, 4), (4, 4) 
4. (—1, 3), (0, 0), (1, 1), (4, 58) 


(2006, 5), (2007, 7), (2008, 12) (z = x — 2007) 


(z = x — 2005) 


. Writing Try to fit the graph of a polynomial function to the 


values shown in the table. What happens, and why? 


. The graph of a function f passes through the points (0, 1), (2, ), 


and (4, 4), Find a quadratic function whose graph passes through 
these points. 


. Find a polynomial function p of degree 2 or less that passes 


through the points (0, 1), (2,3), and (4,5). Then sketch the 
graph of y = 1/p(x) and compare this graph with the graph of 
the polynomial function found in Exercise 8. 

Calculus The graph of a parabola passes through the points 
(0, 1) and (5, 5) and has a horizontal tangent at (3, 3). Find an 
equation for the parabola and sketch its graph. 

Calculus The graph of a cubic polynomial function has 
horizontal tangents at (1, —2) and (— 1, 2). Find an equation for 
the cubic and sketch its graph. 


Find an equation of the circle passing through the points 
(1, 3), (—2, 6), and (4, 2). 


13. 


The U.S. census lists the population of the United States as 
227 million in 1980, 249 million in 1990, and 281 million in 2000. 
Fit a second-degree polynomial passing through these three points 
and use it to predict the population in 2010 and in 2020. (Source: 
U.S. Census Bureau) 


. The U.S. population figures for the years 1920, 1930, 1940, and 


1950 are shown in the table. (Source: U.S. Census Bureau) 


Year 1920 1930 1940 1950 
Population 
(in millions) 106 123 132 151 


(a) Find a cubic polynomial that fits these data and use it to 
estimate the population in 1960. 

(b) The actual population in 1960 was 179 million. How 
does your estimate compare? 


. The net profits (in millions of dollars) for Microsoft from 2000 


to 2007 are shown in the table. (Source: Microsoft Corporation) 


Year 2000 2001 2002 2003 
Net Profit 9421 10,003 10,384 10,526 
Year 2004 2005 2006 2007 
Net Profit 11,330 125715 12,599 14,410 


(a) Set up a system of equations to fit the data for the years 
2001, 2003, 2005, and 2007 to a cubic model. 

(b) Solve the system. Does the solution produce a reason- 
able model for predicting future net profits? Explain. 


45) 16. The sales (in billions of dollars) for Wal-Mart stores from 2000 


(pM to 2007 are shown in the table. (Source: Wal-Mart) 
Year 2000 2001 2002 2003 
Sales 191.3 217.8 244.5 256.3 
Year 2004 2005 2006 2007 
Sales 285.2 312.4 346.5 377.0 


(a) Set up a system of equations to fit the data for the years 
2001, 2003, 2005, and 2007 to a cubic model. 

(b) Solve the system. Does the solution produce a reason- 
able model for predicting future sales? Explain. 


17. Use sin 0 = 0, sin(z/2) = 1, and sin 7 = 0 to estimate sin(z/3). 
18. Use log, 1 = 0, log, 2 = 1, and log, 4 = 2 to estimate log, 3. 


19. Guided Proof Prove that if a polynomial function p(x) = 
dy + ax + ax? is zero for x = —1, x = 0, and x = 1, then 
dy = a, = a, = 0. 
Getting Started: Write a system of linear equations and solve 
the system for dp, a,, and a. 


(i) Substitute x = —1, 0, and 1 into p(x). 
(ii) Set the result equal to 0. 
(iii) Solve the resulting system of linear equations in the 
variables dp, a,, and a5. 


20. The statement in Exercise 19 can be generalized: If a polynomial 
function p(x) = ay + ayx ++ + + + a,_,x"~ is zero for more 
than n — 1 x-values, then dy =a, =: °° a,—, = 9. Use 

this result to prove that there is at most one polynomial function 

of degree n — 1 (or less) whose graph passes through n points in 


the plane with distinct x-coordinates. 


Network Analysis 


4) 21. Water is flowing through a network of pipes (in thousands of 
cubic meters per hour), as shown in Figure 1.15. 
(a) Solve this system for the water flow represented by x,, 
i=1,2,...,7. 
(b) Find the water flow when x, = x, = 0. 
(c) Find the water flow when x; = 1000 and x, = 0. 
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600 — —_@— @—— 500 
X3 x4 X5 

600 —~< ~< ~ <— 500 
1 xu 

Figure 1.15 


. The flow of traffic (in vehicles per hour) through a network of 
streets is shown in Figure 1.16. 
(a) Solve this system for x;,i = 1,2,...,5. 
(b) Find the traffic flow when x, = 200 and x, = 50. 
(c) Find the traffic flow when x, = 150 and x, = 0. 


x] 


300 — >— 150 
x2 X4 
200 — >— 350 
x5 
Figure 1.16 


4p) 23. The flow of traffic (in vehicles per hour) through a network of 
streets is shown in Figure 1.17. 


(a) Solve this system for x;, i = 1, 2, 3, 4. 
(b) Find the traffic flow when x, = 0. 
(c) Find the traffic flow when x, = 100. 


200 


xX] x2 
100 100 


X3 x4 


200 
Figure 1.17 
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4) 24. The flow of traffic (in vehicles per hour) through a network of 27. (a) Determine the currents /,, J,, and J, for the electrical 
streets is shown in Figure 1.18. network shown in Figure 1.21. 
(a) Solve this system for x;,i = 1,2,...,5. (b) How is the result affected when A is changed to 2 volts and 
(b) Find the traffic flow when x, = 0 and x; = 100. B is changed to 6 volts? 
(c) Find the traffic flow when x, = x, = 100. ; A: 5 volts 
1 
eal 


400 — C) > >— 600 


x92 h x3 X4 
300 — > >— 100 
45 R3=4 
3 : 
Figure 1.18 Be NOMS 
by) 25. Determine the currents / » J, and J, for the electrical network Piguieé: 1.21 
shown in Figure 1.19. 28. Determine the currents /,, 15, 1, ,, 5, and I, for the electrical 
network shown in Figure 1.22. 
3 volts 
[, 1 
1 14 volts 


25 volts 


4 volts 


Figure 1.19 


J 26. Determine the currents / ,» 5, and J, for the electrical network 
shown in Figure 1.20. 


16 volts Ro=l 8 volts 


Figure 1.22 


In Exercises 29-32, use a system of equations to write the partial 
fraction decomposition of the rational expression. Then solve the 


system using matrices. 


56 4x2 oA B. ¢ 
“G@+026-1) x-1 xt+1 (+1) 

i 8x2 oA B. ,--€ 
“@-Iat)D xt1 > x-1° @-—1P 

R3=4 20 — x A Bo. OC 
pene ate (a Die ee ge 2 Ge 


Figure 1.20 


an 32-7x-12 A , B , C 
"@4+4a—-42 «+4 °x-4° (— 4) 


In Exercises 33 and 34, find the values of x, y, and A that satisfy the 
system of equations. Such systems arise in certain problems of 
calculus, and A is called the Lagrange multiplier. 


33. 2x +A =0 34. 2y+2A+ 2=0 
2y+rA =0 2x A+ 1=0 
xt y  -4=0 x+y — 100 = 0 


35. In Super Bowl XLI on February 4, 2007, the Indianapolis Colts 
beat the Chicago Bears by a score of 29 to 17. The total points 
scored came from 13 scoring plays, which were a combination 
of touchdowns, extra-point kicks, and field goals, worth 6, 1, 
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and 3 points, respectively. The numbers of field goals and 
extra-point kicks were equal. Write a system of equations to 
represent this event. Then determine the number of each type of 
scoring play. (Source: National Football League) 


36. In the 2007 Fiesta Bowl Championship Series on January 8, 
2007, the University of Florida Gators defeated the Ohio State 
University Buckeyes by a score of 41 to 14. The total points 
scored came from a combination of touchdowns, extra-point 
kicks, and field goals, worth 6, 1, and 3 points, respectively. 
The numbers of touchdowns and extra-point kicks were equal. 
The number of touchdowns was one more than three times the 
number of field goals. Write a system of equations to represent 
this event. Then determine the number of each type of scoring 
play. (Source: www.fiestabowl.org) 


Valais Review Exercises 


In Exercises 1-8, determine whether the equation is linear in the 
variables x and y. 


1.2x-y=4 2. 2xy — 6y = 0 

3. (sinm)x + y = 2 4. e 2x + 5y =8 
2 

5. —+ 4y =3 62510 
x y 

7. 5x — Gy =0 8. 2x + jy =2 


In Exercises 9 and 10, find a parametric representation of the 


solution set of the linear equation. 
9. —4x + 2y —- 67 = 1 10. 3x, + 2x, — 4x, = 0 


In Exercises 11-22, solve the system of linear equations. 


Wl xty=2 12, x«+ y=-1l 
3x —y = 0 3x +2y= 0 
13. 3y = 2x 14. x=y+ 3 
y= x+4 4x =y+ 10 
15. y+x=0 16. y = —4x 
2x + y = 0 y= x 
Wx - y= 18. 40x, + 30x, = 24 
—x+ty= 20x, + 15x, = —14 
19. 0.2x, + 0.3x, = 0.14 20. 0.2x — O.ly = 0.07 


0.4x, + 0.5x, = 0.20 0.4x — 0.5y = —0.01 
21. 3x — Gy = 0 22, jx + Gy = 3 
3x + 2(y + 5) = 10 2x + 3y = 15 


In Exercises 23 and 24, determine the size of the matrix. 


aaa | 
23. F : | 24.}-4 -1 
0 5 


In Exercises 25—28, determine whether the matrix is in row-echelon 
form. If it is, determine whether it is also in reduced row-echelon form. 


iL 0 1 1 1 Zz, =3 0 

25. | 0 1 2 1 26. | 0 0 0 1 
0 0 0 i 0 0 0 0 

=! 2 1 0 1 0 0 

27. 0 1 0 28. | 0 0 1 2 
0 0 1 0 0 0 0 


In Exercises 29 and 30, find the solution set of the system of linear 
equations represented by the augmented matrix. 


1 2 0 0 1 2 3 0 
29. | 0 0 1 0 30. | 0 0 0 1 
0 0 0 0 0 0 0 0 


In Exercises 31-40, solve the system using either Gaussian 
elimination with back-substitution or Gauss-Jordan elimination. 


SL. =x yt2z= 1 


32. 2x + 3y + z= 10 
2x + 3y z= -2 2x — 3y —3¢= 22 
5x +4y+2z= 4 4x — 2y + 3z = —2 

33. 2x + 3y Bz = 33 34. 2x + 62= =9 
6x + 6y + 12z = 13 3x — 2y + llz = —16 
l2x+9y- z= 2 Se pk gS = 1 
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35. 


37. 


Chapter 1 


Systems of Linear Equations 


x—-2y+ z=-6 36. x + 2y 6z= 1 
2x — 3y ==7 2x+5y+15z= 4 
—x+3y-3z= 11 3x y 3z==6 
2x y z=4 38. 2x, + 5x, — 19x, = 34 
2x + 2y a 3x, + 8x, — 31x, = 54 
2x- yt6z= 
2x, X> Xe 2 = A 1 
Dy — 2% xX, — 3x,= 0 

X, + 3x, + 2x, + 2x, 1 
3X, + 2x54 3x, = 5x, = 12 
xX, + 5x, + 3x, = 14 

4x, + 2x3 + 5x4 = 3 

3x, + 8x, + 6x5 = 16 

2x, + 4x, —2x5= 0 
2x; =X, = 0 


4) In Exercises 41— 46, use the matrix capabilities of a graphing utility 


to reduce the augmented matrix corresponding to the system of 
equations to solve the system. 


41. 3x + 3y+ 12z= 6 42. 2x+10y+2z= 6 
x+y 4z,= 2 j Sy+2z= 6 
2x + 5y + 20z = 10 x Sy z= 3 
x + 2y 8z= 4 3x°> ISy 7 32¢ = -=9 
43. 2x y z+ 2w 6 
3x + 4y +w= 1 
x + Sy + 2z + 6w = —3 
Sx+2y- z- w= 3 
44. x+2y Zz 4w = ll 
3x + 6y + 5z + 12w = 30 
x + 3y — 3z 2w = —-5 
6x y Zz w=-9 
45. x ytz+ w=0 46. x + 2y+z+ 3w=0 
2x + 3y +z-2w=0 a Ty + w=0 
Sx Oy + Z =0 Sy —z+2w=0 
In Exercises 47-50, solve the homogeneous system of linear 
equations. 
47. x, — 2x, — 8x, =0 48. 2x, + 4x, — 7x, = 0 


Xp = 3X5 F Oxy = 0 
6x, + 9x3 = 0 


49. 


51. 


52. 


53. 


54. 


55. 


56. 


57. 


58. 


2x, — 8x, + 4x, = 0 50. x, + 3x, + 5x, =0 
3x, — 10x, + 7x, = 0 x, + 4x, + 5x, =0 
10x, + 5x; = 0 


Determine the value of k such that the system of linear equations 
is inconsistent. 
kx + y=0 

xtky=1 
Determine the value of k such that the system of linear equations 
has exactly one solution. 
yt2z= 
—x+ y- 

x + ky z=0 

Find conditions on a and b such that the system of linear 
equations has (a) no solution, (b) exactly one solution, and (c) an 
infinite number of solutions. 

x+2y= 3 
ax + by = —9 


x= 


Find (if possible) conditions on a, b, and c such that the system 
of linear equations has (a) no solution, (b) exactly one solution, 
and (c) an infinite number of solutions. 


2x- y+ z=a 

x+ yt2z=b 

3y +32 = ¢ 

Writing Describe a method for showing that two matrices are 
row-equivalent. Are the two matrices below row-equivalent? 

1 1 2 1 2 3 

0 -!il 2 and 4 3 6 

3 1 2 5 5 10 


Writing Describe all possible 2 x 3 reduced row-echelon 
matrices. Support your answer with examples. 


Let n = 3. Find the reduced row-echelon form of the n x n 
matrix. 
1 2 3 n 
n+ n+2 n+ 3 2n 
2n + 1 2n + 2 


Ww—-n+1 n-n+2 w-n 
Find all values of A for which the homogeneous system of 


linear equations has nontrivial solutions. 
(A + 2)x, - 2x, + 3x, = 0 

2x, + (A — 1)x, + 6x; = 0 

Se 2x, + Ax; = 0 


True or False? In Exercises 59 and 60, determine whether each 
statement is true or false. If a statement is true, give a reason or 
cite an appropriate statement from the text. If a statement is false, 
provide an example that shows the statement is not true in all cases 
or cite an appropriate statement from the text. 


59. 


60. 


61. 


62. 


(a) The solution set of a linear equation can be parametrically 
represented in only one way. 


(b) A consistent system of linear equations can have an 
infinite number of solutions. 


(a) A homogeneous system of linear equations must have at 
least one solution. 


(b) A system of linear equations with fewer equations than 
variables always has at least one solution. 


The University of Tennessee Lady Volunteers defeated the 
Rutgers University Scarlet Knights 59 to 46. The Lady 
Volunteers’ scoring resulted from a combination of three-point 
baskets, two-point baskets, and one-point free throws. There 
were three times as many two-point baskets as three-point 
baskets. The number of free throws was one less than the 
number of two-point baskets. (Source: National Collegiate 
Athletic Association) 


(a) Set up a system of linear equations to find the numbers of 
three-point baskets, two-point baskets, and one-point free 
throws scored by the Lady Volunteers. 


(b) Solve your system. 


In Super Bowl I, on January 15, 1967, the Green Bay Packers 
defeated the Kansas City Chiefs by a score of 35 to 10. The 
total points scored came from a combination of touchdowns, 
extra-point kicks, and field goals, worth 6, 1, and 3 points, 
respectively. The numbers of touchdowns and extra-point kicks 
were equal. There were six times as many touchdowns as field 
goals. (Source: National Football League) 


(a) Set up a system of linear equations to find the numbers of 
touchdowns, extra-point kicks, and field goals that were 
scored. 


(b) Solve your system. 


In Exercises 63 and 64, use a system of equations to write the 
partial fraction decomposition of the rational expression. Then solve 
the system using matrices. 


63. 


3x? — 3x —2 A B Cc 
(x + 2)(x-—2)? x+2 x-2 (x-2)/? 
3x°+3x—-2  #4A B Cc 
(x+1?@-1) x+1 x-1 (+1) 
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Polynomial Curve Fitting 


2) In Exercises 65 and 66, (a) determine the polynomial whose graph 
passes through the given points, and (b) sketch the graph of the 
polynomial, showing the given points. 


65 


66. 


oS) 67 


68. 


&3) 69 


&9) 70. 


(2, 5), (3, 0), (4, 20) 
(—1, -1), (0, 0), CL, 1), (2, 4) 


A company has sales (measured in millions) of $50, $60, and 
$75 during three consecutive years. Find a quadratic function 
that fits these data, and use it to predict the sales during the 
fourth year. 

The polynomial function p(x) = ay + a,x + a,x? 4 
zero when x = 1, 2, 3, and 4. What are the values of dp, a), dy, 
and a3? 


a,x> is 


A wildlife management team studied the population of deer in 
one small tract of a wildlife preserve. The population and the 
number of years since the study began are shown in the table. 


Year 


Population 


(a) Set up a system of equations to fit the data to a quadratic 
polynomial function. 


(b) Solve your system. 
(c) Use a graphing utility to fit a quadratic model to the data. 


(d) Compare the quadratic polynomial function in part (b) with 
the model in part (c). 


(e) Cite the statement from the text that verifies your results. 


A research team studied the average monthly temperatures of a 
small lake over a period of about one year. The temperatures and 
the numbers of months since the study began are shown in the 
table. 


Month 


Temperature 


(a) Set up a system of equations to fit the data to a quadratic 
polynomial function. 


(b) Solve your system. 
(c) Use a graphing utility to fit a quadratic model to the data. 


(d) Compare the quadratic polynomial function in part (b) with 
the model in part (c). 


(e) Cite the statement from the text that verifies your results. 
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Network Analysis 4b) 72. The flow through a network is shown in Figure 1.24. 
©e) 71. Determine the currents / » J, and J, for the electrical network (a) Solve the system for x, i= 1,2,...,6. 
shown in Figure 1.23. (b) Find the flow when x, = 100, x; = 50, and x, = 50. 
3 volts 200 


vy 


R3=2 


2 volts 


Figure 1.23 "S 
100 300 


Figure 1.24 


GU Naiaiwee Projects 


1 Graphing Linear Equations 


You saw in Section 1.1 that a system of two linear equations in two variables 
x and y can be represented geometrically as two lines in the plane. These lines can 
intersect at a point, coincide, or be parallel, as indicated in Figure 1.25. 


yx — 
A 


y= 
\, 


Figure 1.25 
1. Consider the system below, where a and b are constants. Answer the 
questions that follow. For Questions (a)—(c), if an answer is yes, give an 
example. Otherwise, explain why the answer is no. 


24> y= 3 
ax + by =6 


(a) 


(b) 


(c) 


Figure 1.26 
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(a) Can you find values of a and b for which the resulting system has a 
unique solution? 

(b) Can you find values of a and b for which the resulting system has 
an infinite number of solutions? 

(c) Can you find values of a and b for which the resulting system has 
no solution? 

(d) Graph the resulting lines for each of the systems in parts (a), (b), 
and (c). 
2. Now consider a system of three linear equations in x, y, and z. Each 
equation represents a plane in the three-dimensional coordinate system. 
(a) Find an example of a system represented by three planes intersecting 
in a line, as shown in Figure 1.26(a). 

(b) Find an example of a system represented by three planes intersecting 
at a point, as shown in Figure 1.26(b). 

(c) Find an example of a system represented by three planes with no 
common intersection, as shown in Figure 1.26(c). 

(d) Are there other configurations of three planes not covered by the three 
examples in parts (a), (b), and (c)? Explain. 


2 Underdetermined and Overdetermined Systems 
of Equations 


The next system of linear equations is said to be underdetermined because there 
are more variables than equations. 


Ma 2X = 3% = 
IDG din ar Ae, — 3) 
Similarly, the following system is overdetermined because there are more equa- 
tions than variables. 
0) or okey =D) 
Pig) = PAG) 5) 
=i, 1° he = 
You can explore whether the number of variables and the number of equations have 
any bearing on the consistency of a system of linear equations. For Exercises 1—4, 
if an answer is yes, give an example. Otherwise, explain why the answer is no. 
1. Can you find a consistent underdetermined linear system? 
2. Can you find a consistent overdetermined linear system? 
3. Can you find an inconsistent underdetermined linear system? 
4. Can you find an inconsistent overdetermined linear system? 
5. Explain why you would expect an overdetermined linear system to be 
inconsistent. Must this always be the case? 
6. Explain why you would expect an underdetermined linear system to have 
an infinite number of solutions. Must this always be the case? 
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Matrices 


2.1 Operations with CHAPTER OBJECTIVES 
Matrices ‘ : ; . 2 : 
22 Pr ies of Matti @ Write a system of linear equations represented by a matrix, as well as write the matrix form 
i Oper eee of a system of linear equations. 
Gbetauons ® Write and sol t f li tions in the form Ax = b 
23° The Inverse of aMlainix rite and solve a system of linear equations in the form Ax = b. 
2.4 Elementary Matrices @ Use properties of matrix operations to solve matrix equations. 
2.5 Applications of Matrix @ Find the transpose of a matrix, the inverse of a matrix, and the inverse of a matrix product 
Operations (if they exist). 
® Factor a matrix into a product of elementary matrices, and determine when they are 
invertible. 
@ Find and use the LU-factorization of a matrix to solve a system of linear equations. 
®@ Use a stochastic matrix to measure consumer preference. 
@ Use matrix multiplication to encode and decode messages. 
@ Use matrix algebra to analyze economic systems (Leontief input-output models). 
@ Use the method of least squares to find the least squares regression line for a set of data. 


2.1 | Operations with Matrices 


In Section 1.2 you used matrices to solve systems of linear equations. Matrices, however, 
can be used to do much more than that. There is a rich mathematical theory of matrices, 
and its applications are numerous. This section and the next introduce some fundamentals 
of matrix theory. 

It is standard mathematical convention to represent matrices in any one of the following 
three ways. 


1. A matrix can be denoted by an uppercase letter such as 
A,B,C... .. 
2. A matrix can be denoted by a representative element enclosed in brackets, such as 


[a;,], [B,;], le], S alae 
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Definition of 
Equality of Matrices 


EXAMPLE 1 
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3. A matrix can be denoted by a rectangular array of numbers 


4; Ayn Ay3 Ain 
44, Ann Ag Ag, 
43, 437 433, 3, 
ant Ain ing iis Ginn 


As mentioned in Chapter 1, the matrices in this text are primarily real matrices. That is, 
their entries contain real numbers. 
Two matrices are said to be equal if their corresponding entries are equal. 


Two matrices A = [a,,] and B = [b,,] are equal if they have the same size (m x n) and 
ay = i; 


for! <ismand1 <j <n. 


Equality of Matrices 


Consider the four matrices 


Matrices A and B are not equal because they are of different sizes. Similarly, B and C are 
not equal. Matrices A and D are equal if and only if x = 3. 


REMARK: The phrase “if and only if’ means the statement is true in both directions. For 
example, “p if and only if g” means that p implies g and g implies p. 


A matrix that has only one column, such as matrix B in Example 1, is called a column 
matrix or column vector. Similarly, a matrix that has only one row, such as matrix C in 
Example 1, is called a row matrix or row vector. Boldface lowercase letters are often used 
to designate column matrices and row matrices. For instance, matrix A in Example | can be 


| as follows. 


‘i ; : 1 
partitioned into the two column matrices a, = 3 and a, = 4 


eh JE idem 
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Definition of 


Matrix Addition 


EXAMPLE 2 


Matrix Addition 


You can add two matrices (of the same size) by adding their corresponding entries. 


Addition of Matrices 


Definition of 
Scalar Multiplication 


a t ay fetet 245) a5 
@ | 0 J+ [} =| os | are | 


0 1-2 0 oO o|]_fo 1 -2 
w |? 2 “f+? 0 os 2 | 


1 = 0 
(c) | -—3] + 3} = ]0 
=) 2 0) 
(d) The sum of 
2 1 0 1 
A= |4 0 -l and B= |-1 3 
3-2 2 4 


is undefined. 


Scalar Multiplication 


When working with matrices, real numbers are referred to as scalars. You can multiply a 
matrix A by a scalar c by multiplying each entry in A by c. 


IfA = La; is an m X n matrix and c is a scalar, then the scalar multiple of A by c is the 
m X n matrix given by 


car lea... 


You can use —A to represent the scalar product (— 1)A. If A and B are of the same size, 
A — B represents the sum of A and (—1)B. That is, 


A-B=A+(-DB. Subtraction of matrices 


EXAMPLE 3 


Section 2.1. Operations with Matrices 


Scalar Multiplication and Matrix Subtraction 


SOLUTION 


REMARK: It is often conven- 
ient to rewrite a matrix B as cA 
by factoring c out of every entry 
in matrix B. For instance, the 


scalar 5 has been factored out of 
the matrix below. 


For the matrices 


1 2 4 2 0 0 
A= |-3 0 -l and B=; 1 -4 3 
2 1 2 =] 3 2 


find (a) 3A, (b) —B, and (c) 3A — B. 


1 2 4 3(1) —-3(2)-—«3(4) 3 6 12 
(a) 3A =3/-3 O —1|=]3(-3) 3(0) 3(-1)]}=]-9 0 -3 
a i 3 3(2) 3(1)-3(2) 6 3 6 
2 0 O —2 © 6 
(b) -B=(-1)} 1 -4 3/=/-1 4 -3 
=i & 3 ae 
> 6 12 2 0 0 1 6 12 
@34=-B=|-9 O =3/—/| 1 =—4 Fle=l- 4 =6 
6 3 6 “1 3 2 7 0 4 
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Matrix Multiplication 


The third basic matrix operation is matrix multiplication. To see the usefulness of this 
operation, consider the following application in which matrices are helpful for organizing 


information. 


A football stadium has three concession areas, located in the south, north, and west 
stands. The top-selling items are peanuts, hot dogs, and soda. Sales for a certain day are 
recorded in the first matrix below, and the prices (in dollars) of the three items are given in 


the second matrix. 


Number of Items Sold 


Peanuts Hot Dogs Soda Selling Price 


South stand 120 250 305 2.00 | Peanuts 
North stand 207 140 419 3.00 | Hot Dogs 
West stand 29 120 190 2.75 | Soda 
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Definition of 
Matrix Multiplication 


EXAMPLE 4 


To calculate the total sales of the three top-selling items at the south stand, you can multi- 
ply each entry in the first row of the matrix on the left by the corresponding entry in the 
price column matrix on the right and add the results. The south stand sales are 


(120)(2.00) + (250)(3.00) + (305)(2.75) = $1828.75. South stand sales 
Similarly, you can calculate the sales for the other two stands as follows. 

(207)(2.00) + (140)(3.00) + (419)(2.75) = $1986.25 North stand sales 

(29)(2.00) + (120)(3.00) + (190)(2.75) = $940.50 West stand sales 


The preceding computations are examples of matrix multiplication. You can write the 
product of the 3 x 3 matrix indicating the number of items sold and the 3 x 1 matrix 
indicating the selling prices as follows. 


120 250 305 || 2.00 1828.75 
207 140 419}| 3.00) = | 1986.25 
29 120 190] | 2.75 940.50 
The product of these matrices is the 3 x 1 matrix giving the total sales for each of the 
three stands. 
The general definition of the product of two matrices shown below is based on the ideas 
just developed. Although at first glance this definition may seem unusual, you will see that 
it has many practical applications. 


If A = [a,,] is an m x n matrix and B = [b,,] is ann x p matrix, then the product AB is 
an m X p matrix 


AB — Le,,] 
where 


in? nj* 


n 
eS Sindy; = aby + Ajyby; + ay3b5; + > + + + And 
k=1 


This definition means that the entry in the ith row and the jth column of the product AB 
is obtained by multiplying the entries in the ith row of A by the corresponding entries in 
the jth column of B and then adding the results. The next example illustrates this process. 


Finding the Product of Two Matrices 


Find the product AB, where 
=] 3 


SOLUTION 


HISTORICAL NOTE 


Arthur Cayley 

(1821-1895) 
showed signs of mathematical 
genius at an early age, but 
ironically wasn’t able to find a 
position as a mathematician 
upon graduating from college. 
Ultimately, however, Cayley made 
major contributions to linear 
algebra. To read about his work, 
visit college.hmco.com/pic/ 
larsonELA6e. 
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First note that the product AB is defined because A has size 3 x 2 and B has size 2 x 2. 
Moreover, the product AB has size 3 x 2 and will take the form 


—1 3 3 > Cy Cy 
4 -2 _4 1 =]Cy) Coo |. 
5 0 Cy C55 


To find c,, (the entry in the first row and first column of the product), multiply correspon- 
ding entries in the first row of A and the first column of B. That is, 


2 <9 C12 
4 =—2 1 =] Co, CoQ]. 
5 0 C3, C30 


Similarly, to find c,,, multiply corresponding entries in the first row of A and the second 
column of B to obtain 


Ci 
\ 
3 =f AI} 
4 -2 ie A =], C9}. 
5 0 C3, C30 


Continuing this pattern produces the results shown below. 


Cy, = (4)(—3) + (—2)(-4) = —-4 
Coy = (4)(2) +(-2)0) = 6 
eg = O39) + O)(-4), = = 15 
C35 = (5)(2) + (0)() = 10 
The product is 
=I 3 -9 1 
AB=| 4 -2 i 1 4. 61. 
—4 
5 0 -15 10 


Be sure you understand that for the product of two matrices to be defined, the number 
of columns of the first matrix must equal the number of rows of the second matrix. That is, 


A B = AB. 
mxn nxp m xX p 
equal 
size of AB 


So, the product BA is not defined for matrices such as A and B in Example 4. 
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The general pattern for matrix multiplication is as follows. To obtain the element in the ith 
row and the jth column of the product AB, use the ith row of A and the jth column of B. 


aeig Cig, (Cpe aie & Chee ee 
41; 42 443 Gin bb: --M-- +b 11 “12 lj Ip 

beck 11 12 lj Ip Cc Cae oe 6.1 as ao oe Be 
421 422 4173 Gl) bp pb... . 21 © 22 2j 2p 
: ; F 1 92 9 2p : 5 ‘ z 
: : : ‘ b3, b3) . 37 3p | = : oe 
Gi 42 43° °° Gin a. . . Ci Cia aCe Cip 
; ; : : bu Bo We 

eee uy np 
Gn Anz Gna Ginn Cm ©m2 Cj Cmp 


Discovery 


1 2 0 
ial Feehan 


CalculateA + BandB +A. 


In general, is the operation of matrix addition commutative? Now calculate AB and BA. 
/s matrix multiplication commutative? 


EXAMPLE 5| Matrix Multiplication 


i @ aj)" 2 2 =f =i 
of eft e a-es ry 
a |i 3 6 6 
2x3 3 %3 2%3 
4|[1 0 3 4 
(b) | ‘| E 4 7 & | 
2x2 2x2 2x2 
[ ‘lle aa "| 
Ol, all 1 -u=lo 1 
2x2 2x2 2x2 
2 
(d) [1 2 3]}-1 [1] 
1 
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2 2 -4 -6 
(ec) |-1][1 -2 -3]=/-1 2 3 
1 1 =2 =3 

3% 1 Les Be ae 


REMARK: Note the difference between the two products in parts (d) and (e) of 
Example 5. In general, matrix multiplication is not commutative. It is usually not true that 
the product AB is equal to the product BA. (See Section 2.2 for further discussion of the 
noncommutativity of matrix multiplication.) 


Technolo Sy Ries graphing utilities and computer software programs can perform matrix addition, scalar 
Mies = Multiplication, and matrix multiplication. If you are using a graphing utility, your screens for 
Example 5(c) may look like: 


Keystrokes and programming syntax for these utilities/programs applicable to Example 5(c) are 
provided in the Online Technology Guide, available at college hmco.com/pic/larsonELAG6e. 


Systems of Linear Equations 


One practical application of matrix multiplication is representing a system of linear 
equations. Note how the system 


AyjX, + AyyXy + Ay3X3 = dD, 

Ay) X; + AyyX + Ay3X3 = dy 

3X, + Ax Xy + 33x; = b; 
can be written as the matrix equation Ax = b, where A is the coefficient matrix of the 
system, and x and b are column matrices. You can write the system as 


4, 4g 3] | b, 
Ay, Ay y3 | |X| = | Dp]. 
43; 439, 433.1 L%3 bs 


A x = b 
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EXAMPLE 6| Solving a System of Linear Equations 


Solve the matrix equation Ax = 0, where 


xy 


1 = 2 1 0 
a=| | x =|x,|, and o-|'| 
2 3 =2. 0 


SOLUTION | Asasystem of linear equations, Ax = 0 looks like 


xX, — 2x, + x,=0 
2x, + 3x, — 2x3 = 0. 


Using Gauss-Jordan elimination on the augmented matrix of this system, you obtain 
1 0-4 0 
0 1 -$ of 
So, the system has an infinite number of solutions. Here a convenient choice of a 
parameter is x,; = 7f, and you can write the solution set as 
x, =, xX, = 41, x; = 7t, tis any real number. 
In matrix terminology, you have found that the matrix equation 
xy 
b =2 | H 
xX | = 
2 3 2. 0 
X3 


has an infinite number of solutions represented by 


x; t 1 
xX =|x,| = |4t] =2/ 4], fis any scalar. 
X5 Tt 7 


That is, any scalar multiple of the column matrix on the right is a solution. 


Partitioned Matrices 


The system Ax = b can be represented in a more convenient way by partitioning the 
matrices A and x in the following manner. If 


41, G2 °° Ay x) db, 


an n x, b 


EXAMPLE 7 
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are the coefficient matrix, the column matrix of unknowns, and the right-hand side, respec- 
tively, of the m x n linear system Ax = b, then you can write 


Ax =b 
ai; Ay2 Gin || *1 
21 a2) 2n *9 = 
Qin 1 And Ginn Xn 
AyyXy + AyyXy Fo + AX, 
Ay X_ + AgyXy Fs + AyyX, | _ b 
Ani X] + AnrXy + Ginn 
ay a1 a 
a a a 
21 22 2 
xX, +x, “| +: +x] “"|=b 
Qink An2 Ginn 
In other words, 
Ax = x;a, + xa, +--+ +x,a, =b, 
where a,, a,,. . .,a,, are the columns of the matrix A. The expression 
ay A190 Gin 
a a a 
21 22 2n 
xy +X) + + Oe 
Qin\ Ain2 Ginn 
is called a linear combination of the column matrices a,, a,,. . .,a, with coefficients 
Xp Koga s 45.Xps 


In general, the matrix product Ax is a linear combination of the column vectors a,, a5, 

. ., a, that form the coefficient matrix A. Furthermore, the system Ax = b is consistent 

if and only if b can be expressed as such a linear combination, where the coefficients of the 
linear combination are a solution of the system. 


Solving a System of Linear Equations 


The linear system 
xX, + 2x, + 3x, =0 
4x, + 5x, + 6x, = 3 
Tx, + 8x, + 9x, = 6 
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Technology 
Note 


Many real-life applications of 
linear systems involve enormous 
numbers of equations and 
variables. For example, a flight 
crew scheduling problem for 
American Airlines required the 
manipulation of matrices with 
837 rows and more than 


12,750,000 columns. This 
application of linear program- 
ming required that the problem 
be partitioned into smaller pieces 
and then solved on a CRAY Y-MP 


supercomputer. 


(Source: Very-Large Scale Linear 
Programming, A Case Study in Combining 
Interior Point and Simplex Methods, 

Bixby, Robert E,, et al., Operations 
Research, 40, no. 5, 1992.) 


can be rewritten as a matrix equation Ax = b, as follows. 


1 2 3 0 
x) 4] + x} 5] + x) 6} = 13 
| 8 9 6 
Using Gaussian elimination, you can show that this system has an infinite number of 
solutions, one of which is x, = 1, x, = 1, x; 1. 
1 2 3 0 
1)4] + 1]5]| + (-1)]/ 6] =]3 
7 8 9 6 


That is, b can be expressed as a linear combination of the columns of A. This representa- 
tion of one column vector in terms of others is a fundamental theme of linear algebra. 


Just as you partitioned A into columns and x into rows, it is often useful to consider an 
m X n matrix partitioned into smaller matrices. For example, the matrix on the left below 
can be partitioned as shown below at the right. 


1 2 0 0 i #2iu @ 
3 4 0 O 3 4/0 #O 
=f =< 2 I =f =2 02 4 


The matrix could also be partitioned into column matrices 
1 2 0) 0 
3) 4 |] 0 ] O]J=[e, cG ec el 
—-1!-2 2 1 


or row matrices 


1 2 0 07 fr, 
3 4 0 Of=|r, 
-1 -2 2 1] ky, 


NTC) \ ae Exercises 


In Exercises 1—6, find (a) A + B, (b) A — B, (c) 2A, (d) 2A — B, 


and (e) B + 3A. 


 =1 2 
ve eee 
2 i =1 


3 2 1 0 2 1 
5. A =| 2 4 i r-|: 4 | 
0 1 2 2 1 0 
2 3 4 0 6 2, 
cael 1 “| r-| 4 1 j 
| 2 0 1 =] 2 4 
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7. Find (a) c, and (b) c,,, where C = 2A — 3B, iM In Exercises 19 and 20, find (a) 2A + B, (b) 3B — A, (c) AB, and 
(d) BA (if they are defined). 
= 5 4 4 fl 2 =7 


=i + 2 2. =1 3 


8. Find (a) c,3 and (b) c35, where C = 5A + 2B, 3-3 1 2 3-4 


19, A = 


4 11 -9 1 0 5 2 -1 3 0 1 2 
A=| 0 3 2), and B=|]-4 6 11). 5 I o=2. = 4 1 3 
=3 1 1 =6 4 9 2 2 3 -4 -1 —-2 
9. Solve for x, y, and z in the matrix equation 1 | 4 l 2 
x y| _ y Z 4 a 2. =3 1 3 -1 2 
qr a) es SI p-|0 2-3 0 1-1 
1 2 3 2 1 -1 
10. Solve for x, y, z, and w in the matrix equation 2-1 -3 0 4 2 
ki ‘| = ie ‘| " a] a 1-2 4 -2 -4 -1 
y x 2 -i1 Zz x ps 1 2 2 21 


In Exercises 11-18, find (a) AB and (b) BA (if they are defined). 


1 A=() ob B= [4 I aa oe 
4 2 =1 8 1 0 -ti 2 4 
1 —-1l 7 1 1 2 QQ 3 2 1 -—4 
12,.A=|]2 —-1 8}, B=|2 1 1 
5 2 1 3 2 1 
= es a a a a a | 
= vs Dob. 30 _|4 0 1 3-2 1 
13.A=|-3 4], B=|4 0 2 B=), 4 3-1 2 3 
1 6 8 =-1 7 -2 1 4 3 -2 2 
2 1 —2 3 4 -2 -1 
14, A = [3 - 1], =|3 In Exercises 21-28, let A,B, C,D, and E be matrices with the 
0 provided orders. 
—- 2 1 2 A: 3x4 B: 3x4 C: 4x2 D: 4x2 EB: 4x3 
15.A=| 4 5|, B= | 
0 2 0 i, If defined, determine the size of the matrix. If not defined, provide 
an explanation. 
0 -1 0 2 
iA=|4 Oo a pele 21.A+B 22C+E 23. 5D 24, —4A 
: =] 7 1 25. AC 26. BE 27, E— 2A 28. 2D + C 
0 In Exercises 29-36, write the system of linear equations in the form 
7.A= = , B=[10 12] Ax = b and solve this matrix equation for x. 
6 29. —x,+xy=4 30. 2x, + 3x, = 5 
—2x, + x, = 0 x, + 4x, = 10 
1 0 3-2 + 1 6 
18. A = li 30 8-17 Fal B= b | 31. —2x, -3x, = —4 32. —4x, + 9x, = -13 
6x, + x, = —36 X= 3%.= 12 
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33. x, — 2x, + 3x, = 9 34. x, + x — 3x, = —1 
Ky 3x5 tg = —6 —X, + 2x, = i 
2% — 5X5 F O%y = 17 Xo as ag 
35. x; 5x) + 2x3 = —20 
3x, 4 X5 X3 8 
2x, + Sx, = —16 
36.x%,- x +4x,= 17 
x, + 3x, =i) 
—6x, + 5x; = 40 


In Exercises 37 and 38, solve the matrix equation for A. 
37 E “l4-l, 4 38 i l4-(, 1 
“13 5 0 1 “13 -2 Oo 1 

In Exercises 39 and 40, solve the matrix equation for a, b, c, and d. 
1 2\l|a b 6 3 

ye 3 | b | 7 fe | 
a b||2 1 3 17 

aM b ‘| E 7 lj | 


41. Find conditions on w, x, y, and z such that AB = BA for the 
matrices below. 


x 1 1 
and B= 
Zz =i 1 
42. Verify AB = BA for the following matrices. 
ois lies a —sin | a ie B —sin A 


sina cosa sinB cos B 


A square matrix 


ain 0 QO. ss7 0 
Oa 0 --- 0 
A=|0 0 m--- 0 
0 O -:: O Gn 


is called a diagonal matrix if all entries that are not on 
the main diagonal are zero. In Exercises 43 and 44, find the prod- 
uct AA for the diagonal matrix. 


=i 0 0 2 0 0 
43.A=] 0 2 0 44.A=/0 -3 0 
0 0 3 0 0 0 


In Exercises 45 and 46, find the products AB and BA for the 
diagonal matrices. 


2 0 —-5 0 
sa=[? | a=[-5 9 


3 0 0 = 0 0 
46.A=]0 —5 O|, B= 0 4 0 
0 0 0 0 0 12 


47. Guided Proof Prove that if A and B are diagonal matrices 
(of the same size), then AB = BA. 


Getting Started: To prove that the matrices AB and BA are 
equal, you need to show that their corresponding entries are 
equal. 

(i) Begin your proof by letting A = [a,,] and B = [b,,] be 

two diagonal n x n matrices. 7 
(ii) The ith entry of the product AB is c;; = by Dy. 


(iii) Evaluate the entries c;, for the two cases i # j andi = j. 
(iv) Repeat this analysis for the product BA. 


48. Writing LetAandB be 3 x 3 matrices, where A is diagonal. 


(a) Describe the product AB. Illustrate your answer with 
examples. 

(b) Describe the product BA. Illustrate your answer with 
examples. 

(c) How do the results in parts (a) and (b) change if the 
diagonal entries of A are all equal? 


In Exercises 49-52, find the trace of the matrix. The trace of an 
n X n matrix A is the sum of the main diagonal entries. That is, 
Tr(A) = a,, tay. +--+ + +a 


nn 


1 2 3 1 0 0 
49./0 —2 + 50. | 0 1 0 

3 1 3 0 0 1 

1 0 2 1 1 4 3 2 

0 f <1 2 4 0 6 1 
t 4 2 1 0 oe 3 6 2 1 

0 0 5 1 2 1 | =3 


53. Prove that each statement is true if A and B are square matrices 
of order n and c is a scalar. 
(a) Tr(A + B) = Tr(A) + Tr(B) 
(b) Tr(cA) = cTr(A) 

54. Prove that if A and B are square matrices of order n, then 
Tr(AB) = Tr(BA). 


55. 


56. 


57. 


58. 


59. 


60. 


61. 


62. 


Show that the matrix equation has no solution. 


Litto a 


Show that no 2 x 2 matrices A and B exist that satisfy the matrix 
equation 


In 
AB — BA = F 
0 1 


Let i = /—Tand let A = le "| and B = ° =I 
Ll 


(a) Find A?, A, and A‘. Identify any similarities among i?, i3, 
and i+. 
(b) Find and identify B?. 


Guided Proof Prove that if the product AB is a square matrix, 
then the product BA is defined. 

Getting Started: To prove that the product BA is defined, you 
need to show that the number of columns of B equals the 
number of rows of A. 

G) Begin your proof by noting that the number of 
columns of A equals the number of rows of B. 
You can then assume that A has size m x n and B has 
size n X p. 
Use the hypothesis that the product AB is a square 
matrix. 


Prove that if both products AB and BA are defined, then AB and 
BA are square matrices. 


(ii) 
(iii) 


Let A and B be two matrices such that the product AB is 
defined. Show that if A has two identical rows, then the 
corresponding two rows of AB are also identical. 


Let A and B ben x n matrices. Show that if the ith row of A has 
all zero entries, then the ith row of AB will have all zero entries. 
Give an example using 2 x 2 matrices to show that the converse 
is not true. 


The columns of matrix T show the coordinates of the vertices of 
a triangle. Matrix A is a transformation matrix. 


0 -1 I 2 3 
A= = 
1 af y li 4 | 
(a) Find AT and AAT. Then sketch the original triangle and 
the two transformed triangles. What transformation does 
A represent? 
(b) A triangle is determined by AAT. Describe the transfor- 


mation process that produces the triangle determined 
by AT and then the triangle determined by 7. 


63. 


64. 


65. 


eb) 66. 
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A corporation has three factories, each of which manufactures 
acoustic guitars and electric guitars. The number of guitars of 
type i produced at factory j in one day is represented by a,; in the 
matrix 


50 
100 


Find the production levels if production is increased by 20%. 


A corporation has four factories, each of which manufactures 
sport utility vehicles and pickup trucks. The number of vehicles 
of type i produced at factory j in one day is represented by a,; in 


the matrix 
‘a 
60] 


A= ee 90 
Find the production levels if production is increased by 10%. 


20 


70 


40 60 


A fruit grower raises two crops, apples and peaches. Each of 
these crops is shipped to three different outlets. The number of 
units of crop 7 that are shipped to outlet j is represented by a,; in 
the matrix 


A= br 100 | 

100 175 125} 
The profit per unit is represented by the matrix 
B = [$3.50 $6.00]. 


Find the product BA and state what each entry of the product 
represents. 


A company manufactures tables and chairs at two locations. 
Matrix C gives the total cost of manufacturing each product at 
each location. 


Location 1 Location 2 
_ Tables | 627 681 | 
Chairs | 135 150 


(a) If labor accounts for about 2 of the total cost, determine 
the matrix L that gives the labor cost for each product at 
each location. What matrix operation did you use? 

(b) Find the matrix M that gives material costs for each 
product at each location. (Assume there are only labor 
and material costs.) 
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True or False? In Exercises 67 and 68, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


67. (a) For the product of two matrices to be defined, the number of 
columns of the first matrix must equal the number of rows 
of the second matrix. 


(b) The system Ax = b is consistent if and only if b can be 
expressed as a linear combination, where the coefficients of 
the linear combination are a solution of the system. 


68. (a) If A is an m x n matrix and B is ann x r matrix, then the 
product AB is an m x r matrix. 


(b) The matrix equation Ax = b, where A is the coefficient 
matrix and x and b are column matrices, can be used to 
represent a system of linear equations. 


69. Writing The matrix 
ToR To D Tol 
From R | 0.75 0.15 0.10 
P = From D} 0.20 0.60 0.20 
FromI {0.30 0.40 0.30 


represents the proportions of a voting population that change 
from party i to party j in a given election. That is, p,; (i # j) 
represents the proportion of the voting population that changes 
from party i to party j, and p,, represents the proportion that 
remains loyal to party i from one election to the next. Find the 
product of P with itself. What does this product represent? 


70. The matrices show the numbers of people (in thousands) who 
lived in various regions of the United States in 2005 and the 
numbers of people (in thousands) projected to live in those 
regions in 2015. The regional populations are separated into 
three age categories. (Source: U.S. Census Bureau) 


2005 
0-17 18-64 65+ 


Northeast 12,607 34,418 6286 


Midwest 16,131 41,395 7177 
South 26,728 63,911 11,689 
Mountain 5306 12,679 2020 


Pacific 12,524 30,741 4519 


2015 
0-17 18-64 65+ 


Northeast 12,441 35,289 8835 


Midwest 16,363 42,250 9955 
South 29,373 73,496 17,572 
Mountain 5263 14,231 3337 


Pacific 12,826 33,292 7086 


(a) The total population in 2005 was 288,131,000 and the 
projected total population in 2015 is 321,609,000. Rewrite 
the matrices to give the information as percents of the total 
population. 


(b) Write a matrix that gives the projected changes in the 
percents of the population in the various regions and age 
groups from 2005 to 2015. 

(c) Based on the result of part (b), which age group(s) is (are) 
projected to show relative growth from 2005 to 2015? 


In Exercises 71 and 72, perform the indicated block multiplication 
of matrices A and B. If matrices A and B have each been partitioned 
into four submatrices 
A= ie ru and R= i ak 

Ax, Axo By, By 
then you can block multiply A and B, provided the sizes of the 
submatrices are such that the matrix multiplications and additions 
are defined. 


AB = be a ie | 
Ay, Ag ILB,, Bay 
= oe + AyBy, Ay By + | 
Ay)By, + Ag Bx; A1By. + Aa Bo» 


1 2)]0 
1 2]0 0 
-1 140 
MA=/0 1/0 4x0], B= — 
0 o]1 
0 o|]2 41 
0 oO | 3 
als 1 2/3 4 
0 o|];Oo0 1 5 6/7 8 
nee =, ole of? ly ole 4 
0-1/0 =O 5 6/7 8 
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In Exercises 73-76, express the column matrix b as a linear combi- 1 — 


nation of the columns of A. 


73.4=| 3 ms ‘| b=| 7 


3. =3 1 
1 2 + 
74.A=|]-1 0 2), b= 
0 1 3 
THEOREM 2.1 


Properties of Matrix 
Addition and Scalar 
Multiplication 


PROOF 


3 

75. A =|1 0 -1|, b=]1 
2 =f -=1 0 

=3 5 —22 

76. A = 3 4), b= 4 
4 -8 32 


[2.2 | Properties of Matrix Operations 


In Section 2.1 you concentrated on the mechanics of the three basic matrix operations: 
matrix addition, scalar multiplication, and matrix multiplication. This section begins to 
develop the algebra of matrices. You will see that this algebra shares many (but not all) of 
the properties of the algebra of real numbers. Several properties of matrix addition and 
scalar multiplication are listed below. 


If A, B, and C are m x n matrices and c and d are scalars, then the following properties 
are true. 


1lA+B=B+t+A Commutative property of addition 
2.A+(B+C)=(A+B)+C Associative property of addition 

3. (cd)A = c(dA) Associative property of multiplication 
4, 1A=A Multiplicative identity 

5. c(A + B) = cA + cB Distributive property 

6. (c + dA =cA+dA Distributive property 


The proofs of these six properties follow directly from the definitions of matrix addition, 
scalar multiplication, and the corresponding properties of real numbers. For example, to 
prove the commutative property of matrix addition, let A = [a,,] and B = [b,,]. Then, using 
the commutative property of addition of real numbers, write 


At+B= la,; + bi] a [D,; ° aij] = BTA. 


Similarly, to prove Property 5, use the distributive property (for real numbers) of multipli- 
cation over addition to write 


c(A + B) = Lela, + b,)] = Lea; + cb;;] =cA+t cB. 


The proofs of the remaining four properties are left as exercises. (See Exercises 47-50.) 
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EXAMPLE 1 


In the preceding section, matrix addition was defined as the sum of two matrices, making 
it a binary operation. The associative property of matrix addition now allows you to write 
expressions such as A + B + Cas (A + B) + CorasA + (B + C). This same reasoning 
applies to sums of four or more matrices. 


Addition of More than Two Matrices 


THEOREM 2.2 
Properties of 
Zero Matrices 


By adding corresponding entries, you can obtain the sum of four matrices shown below. 


1) [-1]) fo 2 2 
2}+}-1]+]1])+]-3}=]-1 
3 2} [4] [-2 1 


One important property of the addition of real numbers is that the number 0 serves as 
the additive identity. That is, c + 0 = c for any real number c. For matrices, a similar prop- 
erty holds. Specifically, if A is an m x n matrix and O,,, is the m x n matrix consisting 
entirely of zeros, then A + O,,,, = A. The matrix O,,,, is called a zero matrix, and it serves 
as the additive identity for the set of all m x n matrices. For example, the following matrix 


serves as the additive identity for the set of all 2 x 3 matrices. 


0 0 0 
05. = 
‘ k 0 0 
When the size of the matrix is understood, you may denote a zero matrix simply by 0. 


The following properties of zero matrices are easy to prove, and their proofs are left as 
an exercise. (See Exercise 51.) 


If A is an m X n matrix and c is a scalar, then the following properties are true. 
i, Alor OL. =A 


mn 


2.A+(-A) =O 


3. IfcA = O,,, thence = OorA = O,,,. 


REMARK: Property 2 can be described by saying that matrix —A is the additive 
inverse of A. 


The algebra of real numbers and the algebra of matrices have many similarities. For 
example, compare the solutions below. 


Real Numbers m X n Matrices 
(Solve for x.) (Solve for X.) 
xt+a=b X+A=B 
x +a+(—a) =b + (-a) X + A+ (—A) = B + (—A) 
x+0=b-a X+O=B-A 
x=b-a X=B-A 


The process of solving a matrix equation is demonstrated in Example 2. 
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EXAMPLE 2| Solving a Matrix Equation 
Solve for X in the equation 3X + A = B, where 


i) +2 =3 4 
A= B= F 
lo : - 2 | 
SOLUTION Begin by solving the equation for X to obtain 


3X =B-A —> X=i(B- A). 


Now, using the given matrices A and B, you have 


att 1B Dee If 


Properties of Matrix Multiplication 


In the next theorem, the algebra of matrices is extended to include some useful properties 
of matrix multiplication. The proof of Property 2 is presented below. The proofs of the 
remaining properties are left as an exercise. (See Exercise 52.) 


THEOREM 2.3 
Properties of 
Matrix Multiplication 


PROOF To prove Property 2, show that the matrices A(B + C) and AB + AC are equal by showing 
that their corresponding entries are equal. Assume A has size m x n, B has sizen x p, and C 
has size n x p. Using the definition of matrix multiplication, the entry in the ith row and jth 
column of A(B + C) is a,,(b,, +c) + + + + a;,(b,; + ¢,,;). Moreover, the entry in the 
ith row and jth column of AB + AC is 

(auby © > = ab.) + (aac + « © a6, ). 


By distributing and regrouping, you can see that these two ijth entries are equal. So, 


A(B + C) = AB + AC. 


The associative property of matrix multiplication permits you to write such matrix 
products as ABC without ambiguity, as demonstrated in Example 3. 
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EXAMPLE 3| Matrix Multiplication Is Associative 


Find the matrix product ABC by grouping the factors first as (AB)C and then as A(BC). 
Show that the same result is obtained from both processes. 


= 0 
kL, =2 1 0 2 
A= ; B= , C=| 3 1 
a | 3. 2 1 
2 4 
SOLUTION Grouping the factors as (AB)C, you have 
el 
ave-( I 2 DP 
2, HUES = 2 1 
2 4 
=I 
_ fe 4 | 3 : _ be i 
=] 2 3 13. 14) 
2 4 
Grouping the factors as A(BC), you obtain the same result. 
=i 
tse) =| 7 |; 0 | 3 
2 =] 3. =2 1 
2 4 


“lp Tle al-[a a] 


Note that no commutative property for matrix multiplication is listed in Theorem 2.3. 
Although the product AB is defined, it can easily happen that A and B are not of the proper 
sizes to define the product BA. For instance, if A is of size 2 x 3 and B is of size 3 x 3, 
then the product AB is defined but the product BA is not. The next example shows that even 
if both products AB and BA are defined, they may not be equal. 


EXAMPLE 4| Noncommutativity of Matrix Multiplication 


Show that AB and BA are not equal for the matrices 


b | F 7 
A= and B= . 
2 =) 0 2 


1 3/;2 —-1 2 5 
SOLUTION ap =|) Slike = (4 | 


EXAMPLE 5 
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Do not conclude from Example 4 that the matrix products AB and BA are never the 
same. Sometimes they are the same. For example, try multiplying the following matrices, 
first in the order AB and then in the order BA. 


F | & ;| 
A= and B= 
1 1 2 +2 


You will see that the two products are equal. The point is this: Although AB and BA are 
sometimes equal, AB and BA are usually not equal. 

Another important quality of matrix algebra is that it does not have a general cancella- 
tion property for matrix multiplication. That is, if AC = BC, it is not necessarily true that 
A = B. This is demonstrated in Example 5. (In the next section you will see that, for some 
special types of matrices, cancellation is valid.) 


An Example in Which Cancellation Is Not Valid 


SOLUTION 


Show that AC = BC. 


ol a | ec 


AC = BC, even though A # B. 


You will now look at a special type of square matrix that has 1’s on the main diagonal 
and 0’s elsewhere. 


1 QO" #2 0 
0 1 ee 
I,=|0 0 1 0 
00 0-7: 1 
For instance, if n = 1, 2, or 3, we have 
1 
1 0 0 0 
1, = (1), 2 = ~ =| Lb Oh 
0) 1 
0 0 1 
1x1 222 a3 


When the order of the matrix is understood to be n, you may denote /,, simply as /. 

As stated in Theorem 2.4 on the next page, the matrix /,, serves as the identity for matrix 
multiplication; it is called the identity matrix of order n. The proof of this theorem is left 
as an exercise. (See Exercise 53.) 
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THEOREM 2.4 ff 4 ig a matrix of size m x n, then the following properties are true. 
Properties of the , 4; —4 
Identity Matrix 2.7,A=A 
As a special case of this theorem, note that if A is a square matrix of order n, then 
AL, =1,A =A. 
EXAMPLE 6| Multiplication by an Identity Matrix 
30 =2 3 =2 
1 0 
(a)| 4 O =| 4 0 
0 1 
=] 1 = 1 
1 0 O}| -—2 =2, 
(b) | 0 1 0 1] = 1 
0 0 1 4 4 
For repeated multiplication of square matrices, you can use the same exponential nota- 
tion used with real numbers. That is, A! = A, A? = AA, and for a positive integer k, A* is 
Ak =AA---A. 
k factors 
It is convenient also to define A° = J, (where A is a square matrix of order 1). These 
definitions allow you to establish the properties 
1. AYAK = A’** and 2. (A/)F = Aik 
where j and k are nonnegative integers. 
EXAMPLE 7|_ Repeated Multiplication of a Square Matrix 
: ; 2 =] 
Find A? for the matrix A = ; 
3 0 
2 =1)72 =1)\/.2. =1 L =2) 2: =1 =4. =] 
SOLUTION A? = = = 
3 0113 O17 L3 0 6 —3)1L3 0 3-6 


In Section 1.1 you saw that a system of linear equations must have exactly one solution, an 
infinite number of solutions, or no solution. Using the matrix algebra developed so far, you 
can now prove that this is true. 


THEOREM 2.5 
Number of Solutions of a 
System of Linear Equations 


Section 2.2 Properties of Matrix Operations 67 


For a system of linear equations in n variables, precisely one of the following is true. 


1. The system has exactly one solution. 
2. The system has an infinite number of solutions. 
3. The system has no solution. 


Represent the system by the matrix equation Ax = b. If the system has exactly one solution 
or no solution, then there is nothing to prove. So, you can assume that the system has at least 
two distinct solutions x, and x,. The proof will be complete if you can show that this assump- 
tion implies that the system has an infinite number of solutions. Because x, and x, are 
solutions, you have Ax, = Ax, = b and A(x, — x,) = O. This implies that the (nonzero) 
column matrix x, = X, — X, is a solution of the homogeneous system of linear equations 
Ax = O. It can now be said that for any scalar c, 


A(x, + cx,) = Ax, + A(cx,) = b + c(Ax,) = b+ cO =b. 


So x, + cx, is a solution of Ax = b for any scalar c. Because there are an infinite number 
of possible values of c and each value produces a different solution, you can conclude that 
the system has an infinite number of solutions. 


The Transpose of a Matrix 


The transpose of a matrix is formed by writing its columns as rows. For instance, if A is 
the m x n matrix shown by 


4, Ayn 443 ain 
49, Ann Ag3 A, 
A=] 43; 43, 43, a3, |> 
Ain\ Qin2 Ain3 Ginn 
Size: m x n 


then the transpose, denoted by A’, is the n x m matrix below 


Gy, 4g, 3p Ay 
Gy Ann, 39), * * * An 

T 
AX =| G3 43 G33 + + ng 
Qn Ayn A3n, Ginn 


Size: n x m 


(A) 
i 


AT 


1 3 
Ly 


i 
i 


(B) 
1-1 
Br 


41 
5 -l 


a 


EXAMPLE 8 


A: [2,4] 


(x8) (AB! 
Bit He | 
AB" 


a 


THEOREM 2.6 
Properties of 
Transposes 


PROOF 


B t uy d _ |120 
> 125 ae te ee, = 
Oe D - 
369 0 0 { Y 
The Transpose of a Matrix 
Find the transpose of each matrix. 
> 1 2 3 1 2 0O 0 1 
@a=|;] (b)B=|]4 5 6 (c) C=]2 1 O (d) D=]|2 4 
7 8 9 0 Oo 1 1 -l 
1 4 7 1 2 O 
(a) A? = [2 8] (b) B)=|2 5 8 (c) C7 =]2 1 O 
3 6 9 0 oO 1 


fo. 2 4 
@ or =|" 4 | 


LetA = I: ‘| and B= K Al 
3 4 |. =] 


Calculate (AB), AB’, and B'A™. Make a conjecture about the transpose of a product of two square 
matrices. Select two other square matrices to check your conjecture. 


T Tr T T T 7 | 
i ee en 
Sel 2 y 4 (4 


If A and B are matrices (with sizes such that the given matrix operations are defined) and 
c is a scalar, then the following properties are true. 


il, GOK SA Transpose of a transpose 

2. (A + B)? = AT + BT Transpose of a sum 

2. (AE = de Transpose of a scalar multiple 
4. (AB)? = BTA? Transpose of a product 


Because the transpose operation interchanges rows and columns, Property 1 seems to make 
sense. To prove Property 1, let A be an m x n matrix. Observe that A’ has size n x m and 
(A’)? has size m x n, the same as A. To show that (A7)? = A you must show that the ijth 
entries are the same. Let a;; be the ijth entry of A. Then q;; is the jith entry of A’, and the 
ijth entry of (A’)’. This proves Property 1. The proofs of the remaining properties are left as 


an exercise. (See Exercise 54.) 
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REMARK: Remember that Properties 2 and 4 can be generalized to cover sums or products of any finite number of 
you reverse the order of matrices. For instance, the transpose of the sum of three matrices is 

multiplication when forming (A+B+O%=AT + BT 4+ C7, 

the transpose of a product. 

That is, the transpose of AB is and the transpose of the product of three matrices is 

(AB)’ = BTA’and is not usually (ABC)! = CTBTAT. 


equal to A7B’. 


Finding the Transpose of a Product 


Show that (AB)" and B7A? are equal. 


2 1 -2 3 1 
A=|-1 0 3 and B=|2 -1 
0 -2 1 3 0 
2 1 =2)13 1 2 1 
SOLUTION AB=]|~-1 0 3/)2 -ll= o =1 
0 -2 1] [3 0 —1 2, 
(aay = [7 6 7 
1 -l 2 
2 =] 0 
a 
=, 3 1 
(AB)? = BTAT 


EXAMPLE 10| The Product of a Matrix and Its Transpose 


For the matrix 


1 3 
A= 0. =2 
=2 =] 


find the product AA’ and show that it is symmetric. 


SOLUTION Because 


1 3 10 6: =35 
1 0 =2 
AAT=| 0 —2 =|-6 4 
3 =2. =1 
=2 1 =) 2 P| 


it follows that AA? = (AA7)’, so AA? is symmetric. 
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REMARK: The property demonstrated in Example 10 is true in general. That is, for any 
matrix A, the matrix given by B = AA” is symmetric. You are asked to prove this result in 


Exercise 55. 


Sane) ae Exercises 


In Exercises 1-6, perform the indicated operations when a = 3, 


b = —4, and 


F ‘| 0 1 
A= , B= 
3 4 =1 2 


1. aA + bB 2A+B 

4. (a + b)B 5. (a — b 
7. Solve for X when 
—4 0 

A= 1 —S5] and B= 
=3 2 


(a) 3X + 2A=B 
(c) X — 3A +2B=O 
8. Solve for X when 


=o. =f 
A=| 1 O| and B= 
3-4 


(a) X = 3A — 2B 
(c) 2X + 3A=B 


In Exercises 9-14, perform the indicated operations, provided that 


c = —2 and 
1 2 3 1 
a= 1 e | e-|_) 
0 0 
o— F 0 
9. B(CA) 10. C(BO) 
12. B(C + O) 13. (cB\(C 


In Exercises 15 and 16, demonstrate that if AC = BC, then A is not 


3. ab(B) 
\(A — B) 6. (ab)O 
1 2 
=—2 1). 
4. 4 


(b) 2A — 5B = 3X 
(d) 6X — 4A —- 3B =O 


0 3 
2 ol. 
-4 -1 


(b) 2X =2A—-B 
(d) 2A + 4B = —2X 


3 0 1 
| c=| af 


11. (B+ OA 


+O) 14. B(cA) 


necessarily equal to B for the following matrices. 


0 1 1 0 
wa-[2 'e-[! 2 


Je-E 3 


1 2 3 4 -6 3 
16. A =|0 5 4|, B= 5 4 4}, 
3. =2 1 = 0 1 
0 0 0 
C=10 0 0 
4 -2 3 


In Exercises 17 and 18, demonstrate that if AB = O, then it is not 
necessarily true that A = O or B = O for the following matrices. 


v.a=(3 | and B=| : 7” 
4 4 =]. 4 
1 
1 


2 4 
were ee 


In Exercises 19-22, perform the indicated operations when 


b 7 k q] 

A= and [= 
‘aus | 0 1 

19. A? 20. A+ 

21. A( + A) 22. A + 1A 


In Exercises 23-28, find (a) A’, (b) A‘A, and (c) AA’. 
1 —-l1 


23.4 = [4 : | 24.A=|3 4 
0 -2 
2 1 -3 -7 ll 12 
2.A=|1 4 1 2%.A=| 4 -3 1 
0 2 1 6 -1 3 


WN oOw 
NR rN 


28. A =|] -1 -2 O 3 
14 -2 12 -9 
6 8 -5 4 


Writing In Exercises 29 and 30, explain why the formula is not 
valid for matrices. Illustrate your argument with examples. 


29. (A + B)(A — B) = A? — B? 
30. (A + B)(A + B) = A? + 2AB + B? 


In Exercises 31-34, verify that (AB)? = BTA’. 


0 
—1 Li =2 
31. =| > 0 and B= 1 2 
1 
3.A=| and =|") “il 
QO. = 2 1 
2 1 
33. A= 0 1} and a=(6 ; =| 
—2 1 
2 I. =1 1 Or 
34. A =|0 1 3| and B=|2 I, 
4 0 2. 0 1 3 


True or False? In Exercises 35 and 36, determine whether each 
statement is true or false. If a statement is true, give a reason or 
cite an appropriate statement from the text. If a statement is false, 
provide an example that shows the statement is not true in all cases 
or cite an appropriate statement from the text. 


35. (a) Matrix addition is commutative. 
(b) Matrix multiplication is associative. 


(c) The transpose of the product of two matrices equals the 
product of their transposes; that is, (AB)” = A7B’. 


(d) For any matrix C, the matrix CC’ is symmetric. 
36. (a) Matrix multiplication is commutative. 
(b) Every matrix A has an additive inverse. 
(c) If the matrices A, B, and C satisfy AB = AC, then B = C. 


(d) The transpose of the sum of two matrices equals the sum of 
their transposes. 


37. Consider the matrices shown below. 


1 1 2 1 0 
X=/0), Y=]1|, Z=|-1], W=]1), O=|0 
1 0 3 1 0 


(a) Find scalars a and b such that Z = aX + bY. 
(b) Show that there do not exist scalars a and b such that 
W = aX + DY. 
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(c) Show that if aX + bY +cW=O, thena=b=c=0. 
(d) Find scalars a, b, and c, not all equal to zero, such that 
aX + bY + cZ = O. 
38. Consider the matrices shown below. 


1 1 1 0 0 
X= |2), Y=|0}], Z=|]4), W=/0], O=1/0 
3 2 4 1 0 


(a) Find scalars a and b such that Z = aX + bY. 

(b) Show that there do not exist scalars a and b such that 
W = aX + bY. 

(c) Show that if aX + bY + cW= O, thena =b=c=0. 

(d) Find scalars a, b, and c, not all equal to zero, such that 
aX + bY + cZ =O. 


In Exercises 39 and 40, compute the power of A for the matrix 


1 0 0 
A=|0 -1l 0}. 
0 0 1 
39. Al? 40. A° 


An nth root of a matrix B is a matrix A such that A” = B. In Exercises 
41 and 42, find the nth root of the matrix B. 


9 0 8 0 0 
a1. B =|? | n=2 42.B=|0 -1 OO], n=3 
0 O 27 


In Exercises 43-46, use the given definition to find f(A): If f is the 
polynomial function, 


f(x) = ag + yx + agx? + +++ + a,x", 


then for ann x n matrix A, f(A) is defined to be 


f(A) = aol, + 4A + aA? +++ +4,A". 


43. f(x) =x? —5x+2, A= lj | 


44. f(x) =x? —7x+6, A B ‘l 


1 2 
45. f(x) = 2? — 3x +2, A= |i al 
2 Lt =1 
46. fx) =8-22+5x-10, A=| 1 0 2 
—1 1 3 
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47. 


48. 


49. 


50. 
51. 
52. 


53. 
54. 
55. 


56. 
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Guided Proof Prove the associative property of matrix 
addition: A + (B+ C) =(A+B)+C. 

Getting Started: To prove that A+ (B+ C) and (A+ B)+ C 
are equal, show that their corresponding entries are the same. 


(i) 


Begin your proof by letting A, B, and C be m x n 


matrices. 
(ii) Observe that the ijth entry of B + Cis b; + cj. 
(iii) Furthermore, the ijth entry of A + (B + C) is 
aj +(b;; ~ Ci). 
(iv) Determine the ijth entry of (A + B) + C. 
Prove the associative property of scalar multiplication: 


(cd)A = c(dA). 

Prove that the scalar | is the identity for scalar multiplication: 
1A =A. 

Prove the following distributive property: (c + d)A = cA + dA. 
Prove Theorem 2.2. 

Complete the proof of Theorem 2.3. 


(a) Prove the associative property of multiplication: 
A(BC) = (AB)C. 
(b) Prove the distributive property: 
(A + B)C = AC + BC. 
(c) Prove the property: c(AB) = (cA)B = A(cB). 
Prove Theorem 2.4. 
Prove Properties 2, 3, and 4 of Theorem 2.6. 


Guided Proof Prove that if A is an m x n matrix, then AA’ 
and A‘A are symmetric matrices. 


Getting Started: To prove that AA’ is symmetric, you need 
to show that it is equal to its transpose, (AA7)? = AA’. 


(i) Begin your proof with the left-hand matrix expression 
(AAT)? 

(ii) Use the properties of the transpose operation to show 
that it can be simplified to equal the right-hand expres- 
sion, AA’. 

(iii) Repeat this analysis for the product A7A. 

Give an example of two 2 x 2 matrices A and B such that 
(AB)? # ATBT. 


In Exercises 57-60, determine whether the matrix is symmetric, 
skew-symmetric, or neither. A square matrix is called skew- 
symmetric if A7 = —A. 


57. 


a-[2 7] wa-[? 3 
=D 0 1 3 


59. 


61. 
62. 


63. 


64. 


65. 


ob) 66. 


0 2, 1 0 2. =i 
A= ]2 0 3 60. A =| —2 0: =3 
1 3 0 1 3 0 


Prove that the main diagonal of a skew-symmetric matrix 
consists entirely of zeros. 


Prove that if A and B are n x n skew-symmetric matrices, then 
A + Bis skew-symmetric. 


Let A be a square matrix of order n. 
(a) Show that 5(A + A’) is symmetric. 
(b) Show that $(A — A’) is skew-symmetric. 


(c) Prove that A can be written as the sum of a symmetric 
matrix B and a skew-symmetric matrix C,A = B+ C. 


(d) Write the matrix 


2 5) 3 
A= |-3 6 0 

4 1 1 
as the sum of a skew-symmetric matrix and a symmet- 
ric matrix. 


Prove that if A is an n Xn matrix, then A — A” is skew- 
symmetric. 


Let A and B be two n x n symmetric matrices. 


(a) Give an example to show that the product AB is not 
necessarily symmetric. 
(b) Prove that AB is symmetric if and only if AB = BA. 


Consider matrices of the form 


0 ay» a3 a4 Ay, 
0 0 473, Ang 22n 
a=|? 9 9 4 73 
0 0 0 0 Qn—1)n 
0 O 0 0 1G 0 


(a) Write a 2 x 2 matrix and a 3 x 3 matrix in the form 
of A. 

(b) Use a graphing utility or computer software program to 
raise each of the matrices to higher powers. Describe 
the result. 

(c) Use the result of part (b) to make a conjecture about 
powers of A if A is a 4 x 4 matrix. Use a graphing 
utility to test your conjecture. 

(d) Use the results of parts (b) and (c) to make a conjecture 
about powers of A if A is ann x n matrix. 


Definition of the 
Inverse of a Matrix 


THEOREM 2.7 
Uniqueness of an 
Inverse Matrix 


PROOF 
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2.3 | The Inverse of a Matrix 


Section 2.2 discussed some of the similarities between the algebra of real numbers and the 
algebra of matrices. This section further develops the algebra of matrices to include the 
solutions of matrix equations involving matrix multiplication. To begin, consider the real 
number equation ax = b. To solve this equation for x, multiply both sides of the equation 
by a7! (provided a # 0). 


ax =b 
(a“!a)x = a7~'b 
(1)x =a~'b 
x=a'b 


The number a~! is called the multiplicative inverse of a because a~'a yields | (the identity 
element for multiplication). The definition of a multiplicative inverse of a matrix is similar. 


Ann x n matrix A is invertible (or nonsingular) if there exists ann x n matrix B such that 
AB = BA = I, 


where J, is the identity matrix of order n. The matrix B is called the (multiplicative) 
inverse of A. A matrix that does not have an inverse is called noninvertible (or singular). 


Nonsquare matrices do not have inverses. To see this, note that if A is of size m x n and 
B is of size n x m (where m # n), then the products AB and BA are of different sizes and 
cannot be equal to each other. Indeed, not all square matrices possess inverses. (See 
Example 4.) The next theorem, however, tells you that if a matrix does possess an inverse, 
then that inverse is unique. 


If A is an invertible matrix, then its inverse is unique. The inverse of A is denoted by A7!. 


Because A is invertible, you know it has at least one inverse B such that 


Suppose A has another inverse C such that 


AC =I= CA. 
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EXAMPLE 1 
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Then you can show that B and C are equal, as follows. 


AB =I 
C(AB) = CI 
(CA)B =C 
IB=C 
B=C 


Consequently B = C, and it follows that the inverse of a matrix is unique. 


Because the inverse A~! of an invertible matrix A is unique, you can call it the inverse 
of A and write 


AA A 7. 


The Inverse of a Matrix 


SOLUTION 


EXAMPLE 2 


Show that B is the inverse of A, where 


= 1 =2 
A=| : ‘| and B=| I 
-1 1 1 -l 


Using the definition of an inverse matrix, you can show that B is the inverse of A by 
showing that AB = J = BA, as follows. 


-1 2])f1 -2 -1+2 2-2 1 0 
ap=| 1 alle = (o 53 eo al-lo i 


1 -2])[-1 2 -1+2 2-2 1 0 
Ba =| a |e le ee en alalo 


REMARK: Recall that it is not always true that AB = BA, even if both products are de- 
fined. If A and B are both square matrices and AB = I, however, then it can be shown that 


BA = I,. Although the proof of this fact is omitted, it implies that in Example | you needed 
only to check that AB = J,. 


The next example shows how to use a system of equations to find the inverse of a matrix. 


Finding the Inverse of a Matrix 


Find the inverse of the matrix 


Lt 


SOLUTION 
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To find the inverse of A, try to solve the matrix equation AX = / for X. 
Li alle) lel i 
—T Bt,  W5 0) 1 
xy, + 4x5, Xyo + ite 7 Fe 1 


Kip = 3% 4 Kis = 3X55 0 1 


Now, by equating corresponding entries, you obtain the two systems of linear equations 
shown below. 


x, + 4x,, = 1 Xy + 4x5, = 0 

—%4, — 3x, = 0 —Xy_ — 3X9 = 1 
Solving the first system, you find that the first column of X is x,; = —3 and x,, = 1. 
Similarly, solving the second system, you find that the second column of X is x,, = —4 and 


X5) = 1. The inverse of A is 


X=A1= ie =I 
1 4 


Try using matrix multiplication to check this result. 


Generalizing the method used to solve Example 2 provides a convenient method for 
finding an inverse. Notice first that the two systems of linear equations 


x,, + 4x,, = 1 Xi, + 4x, = 0 
—X,, — 3x, = 0 X12 — 3X = 1 


have the same coefficient matrix. Rather than solve the two systems represented by 


Lee oi |) 4. oT 
-1 -3 : O -1-3 : 1 


separately, you can solve them simultaneously. You can do this by adjoining the identity 
matrix to the coefficient matrix to obtain 


1 4 4 1 "| 

al=3 2. ty 

By applying Gauss-Jordan elimination to this matrix, you can solve both systems with a 
single elimination process, as follows. 


F 4 : 1 "| 

Oo 1 : 1 1 R, + R,>R, 

k 0 : -3 4] R, + (-4)R,>R, 
Oo 1 1 1 


Applying Gauss-Jordan elimination to the “doubly augmented” matrix [A : J], you obtain 
the matrix [J : A7~!]. 
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Finding the Inverse 
of a Matrix by 
Gauss-Jordan Elimination 


EXAMPLE 3 


1 4 : 1 | E O 3 =3 | 
=i-=—3 a 0; A GO 7 & <b 1 


A I i 


This procedure (or algorithm) works for an arbitrary n x n matrix. If A cannot be row 
reduced to /,,, then A is noninvertible (or singular). This procedure will be formally justified 
in the next section, after the concept of an elementary matrix is introduced. For now the 
algorithm is summarized as follows. 


Let A be a square matrix of order n. 


1. Write the n x 2n matrix that consists of the given matrix A on the left and the n x n 
identity matrix J on the right to obtain [A : J]. Note that you separate the matrices A 
and J by a dotted line. This process is called adjoining matrix / to matrix A. 

2. If possible, row reduce A to J using elementary row operations on the entire matrix 
[A : J]. The result will be the matrix [J : A~']. If this is not possible, then A is 
noninvertible (or singular). 

3. Check your work by multiplying AA~! and A~!A to see that AA~! = J = A“!A. 


Finding the Inverse of a Matrix 


SOLUTION 


Find the inverse of the matrix. 


lL =1 0 
A= 1 0 =1 
—6 2 3 


Begin by adjoining the identity matrix to A to form the matrix 


1-1 0° : 1 0 0O 
[A: I= lt O=1 ¢ O 1 OO} 
=) 2 2.3. 0 7 
Now, using elementary row operations, rewrite this matrix in the form [7 : A~'], as follows. 
1-1 0 : 1 0 0O 
Oo 1-1 : -1 1 0 R, + (-1)R,R, 
=6 223 2 © © 1 
1-1 0 ;: 1 0 O 
Oo Tl ¢-1 1 0 
0-4 3 : 6 0 1 R, + (@)R,>R; 
1-1 0 : 1 0 0O 
Oo 1-1 : -1 1 =0 
0 O-tI 2 4 1 R;, + (4)R,>R; 
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1-1 0O 1 OO O 
Oo 1-i1 —1 1 O 
0 oO 1 =2 =—4- =] (-DR,>R; 
1-1 0O 1 OO O 
0 Jt O =3 =3 —1 R, + R,>R, 
0 oO 1 —2 -4 -1 
1 QQ O. 4 =2 =3 =1 R, +R, >R, 
0 1 0 : -3 -3 -1 
0 oO 1 : —-2 -4 -1 
The matrix A is invertible, and its inverse is 
=2 =3. =—1 
A-t=|-3 =3 =I}. 
—2 -4 -I1 


Try confirming this by showing that AA~! = J = A7!A. 


Technolo Sy Ries graphing utilities and computer software programs can calculate the inverse of a square matrix. 
INihase — 'f you are using a graphing utility, your screens for Example 3 may look like the images below. 

Keystrokes and programming syntax for these utilities/programs applicable to Example 3 are 

provided in the Online Technology Guide, available at college hmco.com/pic/larsonELAG6e. 


The process shown in Example 3 applies to any n x n matrix and will find the inverse 
of matrix A, if possible. If matrix A has no inverse, the process will also tell you that. The 
next example applies the process to a singular matrix (one that has no inverse). 


EXAMPLE 4| A Singular Matrix 


Show that the matrix has no inverse. 
1 2 0) 
A= 3 -1 2 
-—2 3 =2 
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SOLUTION 


Adjoin the identity matrix to A to form 


1 2 0 : 1 0 0O 
[A: I= 3 -l 2 : O 1 0 
—2 3-2 : O 0 1 
and apply Gauss-Jordan elimination as follows. 
1 2 0 : 1 0 0O 
0-7 2 : -3 1 O R, + (-3)R, >R, 
=2 3:2 2 0 O FT 
1 2 0 : 1 0 0O 
O=7 2 23s J 20 
0 7-2 : 2 0 1 R, + (2)R, > R, 


Now, notice that adding the second row to the third row produces a row of zeros on the left 
side of the matrix. 


1 2 0 : 1 0 0O 
QO:=-7 2 2 =3 1 0 
0 0 O :-1 1 1 R,+R,>R, 


Because the “A portion” of the matrix has a row of zeros, you can conclude that it is not 
possible to rewrite the matrix [A : J] in the form [J : A~']. This means that A has no 
inverse, or is noninvertible (or singular). 


Using Gauss-Jordan elimination to find the inverse of a matrix works well (even as a 
computer technique) for matrices of size 3 x 3 or greater. For 2 x 2 matrices, however, you 
can use a formula to find the inverse instead of using Gauss-Jordan elimination. This simple 
formula is explained as follows. 

If A is a2 x 2 matrix represented by 


Ea 
A= F 
c d 


then A is invertible if and only if ad — bc # 0. Moreover, if ad — bc # 0, then the inverse 
is represented by 


1 d —b 
Al =——_ : 
ad — | =¢ | 
Try verifying this inverse by finding the product AA™!. 


REMARK: The denominator ad — bc is called the determinant of A. You will study 
determinants in detail in Chapter 3. 


EXAMPLE 5 
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Finding the Inverse of a 2 x 2 Matrix 


SOLUTION 


THEOREM 2.8 
Properties of 
Inverse Matrices 


PROOF 


If possible, find the inverse of each matrix. 


3s 2] | 
@a=| > | we-| 6 | 


(a) For the matrix A, apply the formula for the inverse of a 2 x 2 matrix to obtain 
ad — be = (3)(2) — (—1)(—2) = 4. Because this quantity is not zero, the inverse is 
formed by interchanging the entries on the main diagonal and changing the signs of the 
other two entries, as follows. 


ea | 


(b) For the matrix B, you have ad — bc = (3)(2) — (—1)(—6) = 0, which means that B is 
noninvertible. 


Blo BIR 
| 


Properties of Inverses 


Some important properties of inverse matrices are listed below. 


The key to the proofs of Properties 1, 3, and 4 is the fact that the inverse of a matrix is unique 
(Theorem 2.7). That is, if BC = CB = I, then C is the inverse of B. 
Property | states that the inverse of A~! is A itself. To prove this, observe that A~'A = 
AA~! = I, which means that A is the inverse of A~!. Thus, A = (A~!)7!. 
1 . : ; 
Similarly, Property 3 states that A is the inverse of (cA), c # 0. To prove this, use 
the properties of scalar multiplication given in Theorems 2.1 and 2.3, as follows. 
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EXAMPLE 6 


(ca(4a~) = ( ‘aa =(is 


c 
c 
ieee 1 _ 
—A~!\(cA) =|-cJA'A = CU) =1 
c c 
1 
So —A7! is the inverse of (cA), which implies that 
c 


EA-t = (cA). 
Cc 


Properties 2 and 4 are left for you to prove. (See Exercises 47 and 48.) 


For nonsingular matrices, the exponential notation used for repeated multiplication of 
square matrices can be extended to include exponents that are negative integers. This may 
be done by defining A~* to be 

AK=A Al.» eA = (AUN, 
_——————— 
k factors 


Using this convention you can show that the properties AYA‘ = A/** and (A/)* = A/* hold 
true for any integers j and k. 


The Inverse of the Square of a Matrix 


SOLUTION 


Compute A~? in two different ways and show that the results are equal. 
bo] 
A= 
2 4 
One way to find A~? is to find (A?)~! by squaring the matrix A to obtain 


3 5 
2= 
z hes ‘| 


and using the formula for the inverse of a 2 x 2 matrix to obtain 


wal 8 


> 
| 
ll 
Nil \| 
r-~SwsdsS 
| 
wo | 
| 
— 
a 
| 
j---— ——-# 
| 
pe N 
| 
NI Rl 
| i a 


Discovery 


THEOREM 2.9 
The Inverse 
of a Product 


PROOF 


EXAMPLE 7 
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and then squaring this matrix to obtain 


NIN whe 


(A-!)2 = 


I 
Alo Bin 
us 


Note that each method produces the same result. 


] 
letA = | 


Calculate (AB)~—', A~'B-", and B~'A~". Make a conjecture about the inverse of a product of two 


nonsingular matrices. Select two other nonsingular matrices and see whether your conjecture 
holds. 


The next theorem gives a formula for computing the inverse of a product of two matrices. 


If A and B are invertible matrices of size n, then AB is invertible and 


(AB) = 8-4 


To show that B~!A~! is the inverse of AB, you need only show that it conforms to the defi- 
nition of an inverse matrix. That is, 


(AB)(B-!A~!) = A(BB~!)A~! = A(NA~! = (ANA7! = AA“! = 1. 


In a similar way you can show that (B~!A~!)(AB) = I and conclude that AB is invertible 
and has the indicated inverse. 


Theorem 2.9 states that the inverse of a product of two invertible matrices is the product 
of their inverses taken in the reverse order. This can be generalized to include the product 
of several invertible matrices: 


(AAAg« 3 “AJ SAS + AAA 


n 


(See Example 4 in Appendix A.) 


Finding the Inverse of a Matrix Product 


Find (AB)~! for the matrices 
1 3 3 1 

A= ]1 4 3 and B= )1 3 3 
1 3 4 2 
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SOLUTION 


THEOREM 2.10 
Cancellation Properties 


PROOF 


using the fact that A~! and B~! are represented by 


do 3) 3 1 =—2 1 
A'=|-1 1 0 and Bl=]-1 1 0}. 
-1 0 1 2 0 -; 
Using Theorem 2.9 produces 
Bo! A7} 

 .=2 1 i =3 =3 & =O), 22 
(AB) !'=B'A-!=|-1 1 O||-1 1 0; =|-8 4 3 
+ 0 -4/|/-1 0 1 5 -2 -} 


REMARK: Note that you reverse the order of multiplication to find the inverse of AB. 
That is, (AB)~! = B~'A™!, and the inverse of AB is usually not equal to A~!B7!. 


One important property in the algebra of real numbers is the cancellation property. That 
is, if ac = bc (c # 0), then a = b. Invertible matrices have similar cancellation properties. 


If C is an invertible matrix, then the following properties hold. 


1. If AC = BC, then A = B. 
2. If CA = CB, then A = B. 


Right cancellation property 
Left cancellation property 


To prove Property 1, use the fact that C is invertible and write 
AC = BC 
(AC)C"! = (BC)C"! 
A(CC~!) = B(CC™!) 
Al = BI 
A=B. 


The second property can be proved in a similar way; this is left to you. (See Exercise 50.) 


Be sure to remember that Theorem 2.10 can be applied only if C is an invertible matrix. 
If C is not invertible, then cancellation is not usually valid. For instance, Example 5 in 
Section 2.2 gives an example of a matrix equation AC = BC in which A # B, because C 
is not invertible in the example. 


THEOREM 2.11 
Systems of Equations 
with Unique Solutions 


PROOF 


SOLUTION 


Systems of Equations 
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In Theorem 2.5 you were able to prove that a system of linear equations can have exactly 
one solution, an infinite number of solutions, or no solution. For square systems (those 
having the same number of equations as variables), you can use the theorem below to 
determine whether the system has a unique solution. 


If A is an invertible matrix, then the system of linear equations Ax = b has a unique 


solution given by 


x = AT, 


Because A is nonsingular, the steps shown below are valid. 


Ax =b 
A 'Ax = A“'b 
Ix = A"'b 
x =A™'b 


This solution is unique because if x, and x, were two solutions, you could apply the 
cancellation property to the equation Ax, = b = Ax, to conclude that x, = x,. 


Theorem 2.11 is theoretically important, but it is not very practical for solving a system 
of linear equations. It would require more work to find A~! and then multiply by b than 
simply to solve the system using Gaussian elimination with back-substitution. A situation 
in which you might consider using Theorem 2.11 as a computational technique would be 
one in which you have several systems of linear equations, all of which have the same 
coefficient matrix A. In such a case, you could find the inverse matrix once and then solve 
each system by computing the product A~'b. This is demonstrated in Example 8. 


EXAMPLE 8| _ Solving a System of Equations Using an Inverse Matrix 


Use an inverse matrix to solve each system. 


(a) 2x + 3y + z 
3x + 3y +z 
2x + 4y + z 


=] 
1 
=2 


(b) 2x + 3y +z=4 
3x + 3y+z=8 
2x+ 4y+z=5 


First note that the coefficient matrix for each system is 


2 


3 
3 


1 


1}. 


(c) 2x + 3y+z=0 
3x + 3y+z=0 
2x +4y+z=0 
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Using Gauss-Jordan elimination, you can find A~! to be 


=] 1 0) 
Al=|-1 0) 1h. 
6 -2 -3 
To solve each system, use matrix multiplication, as follows. 
—1 1 O}|-1 2 
(a) x =A 'b=]-1 0 1 1|/=|-1 
6 -—2 —-3]|-2 —2 
The solution is x = 2, y = —1, andz = —2. 
=] 1 0}/4 4 
(b) x =A 'b=]-1 0 1/|/8}= 1 
6. =2. =3) 5 =7 
The solution is x = 4, y = 1, andz = —7. 
—1 1 0||0 0 
(c)x =A 'b=]|-1 0 1}//0} = ]0 


6 —2 —3]L0} [0 


The solution is trivial: x = 0, y = 0, and z = 0. 


Sante) eee Exercises 


In Exercises 1—4, show that B is the inverse of A. In Exercises 5—24, find the inverse of the matrix (if it exists). 


«(7 ol 


_ _ ; ie | a i i 
24=|) 3 o-| / 4-19 + = 
5 5 1 1 1 1 2 2 
—2 2 3 -4 -5 3 9/3 5 4 10.| 37 9 
a] 1 -1 1 oe —8 | : 6 ] EE —4 E 
oO 1 4 1 2 0 1 2-1 10 5 -7 
2-17 ll t 4&4 2 11.|/3 7 -10 12/-5 1 4 
wae[ i “| | 4 3 F 16 “a | a = 4 
0 3 -2 3 6 -5 
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1 1 2 3 2 5 30. x, + x, Xe  BXy = He 3 
13. | . & @ 14. | 2 2 4 2x, Fx to xy t XytAs= 4 
2 0 3 —4 0 XxX, + XxX, X,+2x,-x,= 3 
01 0.2 0.3 > oO @ rea a ee 
15. -o: 0.2 02 16. f 3 0 See ee 
05 05 0.5 0 0 5 31. 2x, — 3x, + x; —2x,+ x5—4x,= 20 
1 0 0 1 0 0 3x, xX, — 4x, x4 Xe + 2x, = =16 
17. F 18. F 0 0 4x, Xo — 3x, + 4x, Xs + 2x6 = —12 
2 5 5 2 5 5 5x, Xo + 4Xy + 2x, = Sx + 3xg = =—2 
_8 0 0 0 1 0 0 0 xy X_ — 3x, + 4x, — 3x, te = =15 
0 1 0 0 0 2 0 0 3x, Ny + 2x, — 3x, + 2x5 -— 6x5 = 25 
re | 0 0 O 0 ay 0 -2 O 32. 4x, — 2x, + 4x, + 2x, — 5x5 —  % 1 
0 0 0 —-5 0 0 0 3 3x, + 6X5. — 5%. — Ox, + 3X5 3Bxg 11 
] =? =]. =—2 4 8 -—7 14 2x) 3x5 x3 3X4 X5 2X6 0 
BR a 4 2 ar | 6 x, + 4x, — 4x, — 6x, + 2x, + 4x,= —9 
cad ee eee vd | ee 3x, — x5 + 5x3 + 2x4 - 3x5-5xe= 1 
= 4 4 1 . 3 S =e 46 2x, + 3x, — 4x, — 6x, Xe 2x, = —12 
1 0 3 0 1 3-2 0 In Exercises 33-36, use the inverse matrices to find (a) (AB)~', 
(b) (A’)~!, (c) A~?, and (d) (2A)! 
0 2 0 4 0 2 4 6 
Bl 0 3 (0 = le Os =e 4 2 5 7 =3 
IM, 33. Al = i Bl= 
0 2 0 4 oS Of te 3S -7 6 2 0 
In Exercises 25-28, use an inverse matrix to solve each system of _2 1 5S 2 
linear equations. 34. AT} = : i B= i i 
25. (a) x+2y=-1 26. (a) 2x -—y=—-3 ai 
x—2y= 3 at+y= 7 1 -+ 3 24 3 
(b) xT 2y = 10 (b) 2x-y= = 35. At = 3 5 —2], Boi= -3 2 ; 
x— 2y = —-6 2x+y=-3 1 1 1 1 1 > 
(c)x+2y=- (c) 2x -—y= 6 : - = 
x—-2y= 0 2x +y = 10 1 -4 2 6 >. =3 
27, (a) x, + 2x, +x, = 2 28. (a) xX; + x, —2x,= O 36. Ao! = c 1 3}, Bl=|-2 4 -1 
xX, + 2x, — x3 = 4 X,— 2x, + x3= OO 4 2 1 1 3 4 
le i %— %- wal In Exercises 37 and 38, find x such that the matrix is equal to its own 
(b) x, + 2x, +43= 1 (b) x) + xy — 2x, = —1 inverse. 
Xp or 2h5 a =. 3 Xp 2hy R= oD 3 ‘ P 2 
X, — 2x, + x5 3 xy Xo X3 0 37.A = & 3 38. A = = 3 


In Exercises 29-32, use a graphing utility or computer software 


4 program with matrix capabilities to solve the system of linear In Exercises 39 and 40, find x such that the matrix is singular. 
equations using an inverse matrix. ope 4 “f ai ae : 2 
29. x, + 2x, X3 + 3x4 — x5 = —3 7" 1-2-3 7 |=3 + 
Xp = 3X Xq 2k = xe = =3 . . 
om e ¥ de Sage eG In Exercises 41 and 42, find A provided that 
1 2 3 4 5 
a ee ae 41. (2A)-! = ; | 42. (4A)-! = - 5 
2x, Xo XP: 2hy Fg = =3 3 4 —3 2 
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In Exercises 43 and 44, show that the matrix is invertible and find its 
inverse. 


43. A -| sin@ cos AI 


pa tes li 6 tan 
—cos 0 sin 6 


tan@ sec 0 


True or False? In Exercises 45 and 46, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


45. (a) The inverse of a nonsingular matrix is unique. 


(b) If the matrices A, B, and C satisfy BA = CA and A is 
invertible, then B = C. 


(c) The inverse of the product of two matrices is the product of 
their inverses; that is, (AB)~! = A~'B™!. 

(d) If A can be row reduced to the identity matrix, then A is 
nonsingular. 


46. (a) The product of four invertible 7 x 7 matrices is invertible. 


(b) The transpose of the inverse of a nonsingular matrix is equal 
to the inverse of the transpose. 


(c) The matrix I“ ‘| is invertible if ab — dc # 0. 


(d) If A is a square matrix, then the system of linear equations 
Ax = b has a unique solution. 


47. Prove Property 2 of Theorem 2.8: If A is an invertible matrix and 
k is a positive integer, then 


(A‘)7! =A '471 rare -Aot = (A~ 1) 
_——— 
k factors 


48. Prove Property 4 of Theorem 2.8: If A is an invertible matrix, 
then (A7)~! = (A7!)?. 


49. Guided Proof Prove that the inverse of a symmetric nonsin- 
gular matrix is symmetric. 


Getting Started: To prove that the inverse of A is symmetric, 
you need to show that (A~!)7 = A7!. 
(i) Let A be a symmetric, nonsingular matrix. 
(ii) This means that A? = A and A~! exists. 


(iii) Use the properties of the transpose to show that (A~!)7 
is equal to A7!. 


50. Prove Property 2 of Theorem 2.10: If C is an invertible matrix 
such that CA = CB, then A = B. 

51. Prove that if A2 = A, then J — 2A = (J — 2A)7!. 

52. Prove that if A, B, and C are square matrices and ABC = J, then 
B is invertible and B~! = CA. 


53. Prove that if A is invertible and AB = O, then B = O. 


54. Guided Proof Prove that if A? = A, then either A = J or A is 
singular. 
Getting Started: You must show that either A is singular or A 
equals the identity matrix. 
Gj) Begin your proof by observing that A is either singular 
or nonsingular. 
di) If A is singular, then you are done. 


(iii) If A is nonsingular, then use the inverse matrix A~! and 
the hypothesis A* = A to show that A = I. 


55. Writing Is the sum of two invertible matrices invertible? 
Explain why or why not. Illustrate your conclusion with appro- 
priate examples. 


56. Writing Under what conditions will the diagonal matrix 


a, 0 O -::: O 
(0) a, (0) a seks: 0) 
A=|. 7 7 : 
Oo 0. 0 os @ 


nn 
be invertible? If A is invertible, find its inverse. 


57. Use the result of Exercise 56 to find A~! for each matrix. 


-1 0 0 
(ay A=| 0 3 0 
0 0 2 
+ 0 O 
(b)A=|0 | O 
oO © G 


1 2. 
58. | | 
=2 1 


(a) Show that A? — 2A + 5I = O, where / is the identity 
matrix of order 2. 

(b) Show that A~! = 4(27 — A). 

(c) Show that, in general, for any square matrix satisfying 
A? — 2A + 5/ = 0, the inverse of A is given by 


A} =2(21 — A). 
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59. Let ube ann x 1 column matrix satisfying u’u = 1. Then x n 60. Prove that if the matrix / — AB is nonsingular, then so is 
matrix H = 1, — 2uu’ is called a Householder matrix. I — BA. 
(a) Prove that H is symmetric and nonsingular. 61. Let A, D, and P be n x n matrices satisfying AP = PD. If 
P is nonsingular, solve this equation for A. Must it be true that 
/2/2 


A=D? 


(b) Letu = /2/2 . Show that u7u = 1 and calculate the 


0 


Householder matrix H. 


Definition of an 


Elementary Matrix 


EXAMPLE 1 


62. Let A, D, and P ben x n matrices satisfying P~'AP = D. Solve 
this equation for A. Must it be true that A = D? 


63. Find an example of a singular 2 x 2 matrix satisfying A* = A. 


2.4 | Elementary Matrices 


In Section 1.2, the three elementary row operations for matrices listed below were introduced. 
1. Interchange two rows. 

2. Multiply a row by a nonzero constant. 

3. Add a multiple of a row to another row. 


In this section, you will see how matrix multiplication can be used to perform these 
operations. 


An n X n matrix is called an elementary matrix if it can be obtained from the identity 
matrix I, by a single elementary row operation. 


REMARK: The identity matrix [, is elementary by this definition because it can be 
obtained from itself by multiplying any one of its rows by 1. 


Elementary Matrices and Nonelementary Matrices 


SOLUTION 


Which of the following matrices are elementary? For those that are, describe the correspon- 
ding elementary row operation. 


1 0 1 0 0 
1 0 0 

(a) | 0 2 0 (b) (c) | 0 1 0 
0 1 0 

0 0 1 0 0 0 

1 0 0 1 0 1 0 0 

(d) | 0 0 1 (e) E | (f) | 0 2 0 

0 1 0 0 0 -I 


(a) This matrix is elementary. It can be obtained by multiplying the second row of J, by 3. 

(b) This matrix is not elementary because it is not square. 

(c) This matrix is not elementary because it was obtained by multiplying the third row of 
I, by 0 (row multiplication must be by a nonzero constant). 
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(d) This matrix is elementary. It can be obtained by interchanging the second and third 
rows of J,. 

(e) This matrix is elementary. It can be obtained by multiplying the first row of J, by 2 and 
adding the result to the second row. 

(f) This matrix is not elementary because two elementary row operations are required to 
obtain it from J. 


Elementary matrices are useful because they enable you to use matrix multiplication to 
perform elementary row operations, as demonstrated in Example 2. 


EXAMPLE 2| _ Elementary Matrices and Elementary Row Operations 


(a) In the matrix product below, E is the elementary matrix in which the first two rows of 
I, have been interchanged. 


E A 
0 1 0|/0 2 1 1, =3 6 
1 0 Oy); 1 —-3 6| =|0 2 1 
0 0 1} 13 2 =1 3 2, J 


Note that the first two rows of A have been interchanged by multiplying on the left 
by E. 

(b) In the next matrix product, E is the elementary matrix in which the second row of J, 
has been multiplied by 5. 


E A 
1 oO ovf1 0-4 1 1 0-4 1 
0 5 Of]f0 2 6 -4/=/0 1 3 -2 
o 0 ijl tt 2 0 1 3 1 


Here the size of A is 3 x 4. A could, however, be any 3 x nm matrix and multiplication 
on the left by E would still result in multiplying the second row of A by rf 

(c) In the product shown below, E is the elementary matrix in which 2 times the first row 
of J, has been added to the second row. 


A 
1 0 0 1 0 =1 1 0 -1 
2 1 O|;-2 -2 3,;=|0 -2 1 
0 0 1 0 4 > 0 4 5 


Note that in the product EA, 2 times the first row of A has been added to the second row. 


In each of the three products in Example 2, you were able to perform elementary row 
operations by multiplying on the left by an elementary matrix. This property of elementary 
matrices is generalized in the next theorem, which is stated without proof. 


THEOREM 2.12 
Representing Elementary 
Row Operations 


EXAMPLE 3 
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Let E be the elementary matrix obtained by performing an elementary row operation on 
[,,- if that same elementary row operation is performed on an m x n matrix A, then the 
resulting matrix is given by the product EA. 


REMARK: Be sure to remember that in Theorem 2.12, A is multiplied on the left by the 
elementary matrix E. Right multiplication by elementary matrices, which involves column 
operations, will not be considered in this text. 


Most applications of elementary row operations require a sequence of operations. For 
instance, Gaussian elimination usually requires several elementary row operations to row 
reduce a matrix A. For elementary matrices, this sequence translates into multiplication 
(on the left) by several elementary matrices. The order of multiplication is important; the 
elementary matrix immediately to the left of A corresponds to the row operation performed 
first. This process is demonstrated in Example 3. 


Using Elementary Matrices 


SOLUTION 


Find a sequence of elementary matrices that can be used to write the matrix A in 
row-echelon form. 
0 1 3 5 
A= |1 -3 0 2 
2 =6 2 0 


Elementary Row Elementary 
Matrix Operation Matrix 
1 =3 0 2 R,OR, 0 1 0 
0 1 3 i) E,=)1 0 0 
2. *=6 2 0 0 0 1 
L. =3 0 2 1 0 0 
0 1 3 3) E,=| 0 1 0 
0 0 2 —-4 R3+(-2)R, 3 R, =2 0 1 
L +3 0 2 1 0 0 
0 1 3 3) E;=1|0 1 0 
0 o 1 -2 ()R,>R, 0 0 § 


The three elementary matrices E,, E,, and E, can be used to perform the same elimination. 
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Definition of 
Row Equivalence 


THEOREM 2.13 
Elementary Matrices 
Are Invertible 


1 0 Olf 1 0 oO|fo 1 Ojfo 1 3 5 
B=E,EEA=|0 1 Oj] O 1 O|f1 O Of1 -3 O 2 
0 0 4|[-2 0 1]fo oO 1][2 -6 2 Oo 
1 0 Of 1 oO oyf1 -3 oO 2 
=/0 1 o|f o 1 offo 1 3 5 
0 o $][-2 0 1j[2 -6 2 oO 
1 0 Oyf1 -3 0 2 1-3 0 2 
S|0 TF OG. 1 “& B=] 3. 5 
0 0 5{lo 0 2 -4 0 0 1- 


REMARK: The procedure demonstrated in Example 3 is primarily of theoretical interest. 
In other words, this procedure is not suggested as a practical method for performing 
Gaussian elimination. 


The two matrices in Example 3 


0 1 3 5 1 =3 0 2 
A= |1 -3 0 2 and B=/0 1 3 > 
2; = 6 2 0 0 0 L = 2 


are row-equivalent because you can obtain B by performing a sequence of row operations 
on A. That is, B = E,E,E,A. 

The definition of row-equivalent matrices can be restated using elementary matrices, as 
follows. 


Let A and B be m X n matrices. Matrix B is row-equivalent to A if there exists a finite 
number of elementary matrices E,, E,,. . . , E, such that 


[ean ea 58 OIE 


You know from Section 2.3 that not all square matrices are invertible. Every elementary 
matrix, however, is invertible. Moreover, the inverse of an elementary matrix is itself an 
elementary matrix. 


If E is an elementary matrix, then E~! exists and is an elementary matrix. 


To find the inverse of an elementary matrix FE, simply reverse the elementary row 
operation used to obtain E. For instance, you can find the inverse of each of the three 
elementary matrices shown in Example 3 as follows. 


THEOREM 2.14 
A Property of 
Invertible Matrices 


PROOF 


EXAMPLE 4 
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Elementary Matrix Inverse Matrix 
0 1 0 R, OR, 0 1 0 R, OR, 
E, = |1 0 0 Ey! =]1 0 0 
0 0 1 0 0 1 
1 0 0 1 0 0 
i= 1 0 Ey'=|0 1 0 
—2° ) a R, + (-2)R, > R, 2 © R, + (2)R, > R; 
1 0 0 1 0 0 
E; =|0 1 0 E;!=|0 1 0 
0 0 3 (2)R, >; 0 O 2) @R,>R, 


The following theorem states that every invertible matrix can be written as the product 
of elementary matrices. 


A square matrix A is invertible if and only if it can be written as the product of elemen- 
tary matrices. 


The phrase “if and only if” means that there are actually two parts to the theorem. On the 
one hand, you have to show that if A is invertible, then it can be written as the product of 
elementary matrices. Then you have to show that if A can be written as the product of 
elementary matrices, then A is invertible. 

To prove the theorem in one direction, assume A is the product of elementary 
matrices. Then, because every elementary matrix is invertible and the product of invertible 
matrices is invertible, it follows that A is invertible. 

To prove the theorem in the other direction, assume A is invertible. From Theorem 2.11 
you know that the system of linear equations represented by Ax = O has only the trivial 
solution. But this implies that the augmented matrix [A : O] can be rewritten in the 
form [J : O] (using elementary row operations corresponding to E,, E5,. . ., and E,). We 
now have E,: - -E,;E,E,A = J and it follows that A = E,-'E,'E,!- - -E,~!. A can 
be written as the product of elementary matrices, and the proof is complete. 


The first part of this proof is illustrated in Example 4. 


Writing a Matrix as the Product of Elementary Matrices 


Find a sequence of elementary matrices whose product is 


a-[ 3 al 
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Begin by finding a sequence of elementary row operations that can be used to rewrite A in 
reduced row-echelon form. 
Matrix Elementary Row Operation Elementary Matrix 
1 2, (-DR, OR, =1 0) 
Ei= 
0 1 


WwW 
oo 


R, + (—3)R,; > R; 


Cor 
Ny & 
es ee a | 
AS 
II 
—,_1 
| 
Ww — 
© 
a 


| 
| 
| 
| 


1 2 — 1 0) 
0 1 (3)R, > R, : 0 2 
1 | R, + (-2)R,>R, a F | 
0 1 . 0 1 


Now, from the matrix product £,E,E,E,A =I, solve for A to obtain A = 
E, 'E, 'E,~'E,~!. This implies that A is a product of elementary matrices. 


Pe no | E- 
a=| 7 ae alle le ol fol | 
0 i) 1] 10 21L0 1 3 8 


In Section 2.3 you learned a process for finding the inverse of a nonsingular matrix A. 
There, you used Gauss-Jordan elimination to reduce the augmented matrix [A : J] to 
[7 : A~!]. You can now use Theorem 2.14 to justify this procedure. Specifically, the proof 
of Theorem 2.14 allows you to write the product 


I= E,: + + E;E,E,A. 


Multiplying both sides of this equation (on the right) by A~!, we can write 
A'=E,---E;,E,E\I. 
In other words, a sequence of elementary matrices that reduces A to the identity also can be 
used to reduce the identity J to A~!. Applying the corresponding sequence of elementary 
row operations to the matrices A and J simultaneously, you have 
E,: ++ E;E,E,[A : 1] = (7: Au]. 


Of course, if A is singular, then no such sequence can be found. 

The next theorem ties together some important relationships between n x n matrices and 
systems of linear equations. The essential parts of this theorem have already been proved 
(see Theorems 2.11 and 2.14); it is left to you to fill in the other parts of the proof. 


THEOREM 2.15 
Equivalent Conditions 


Definition of 
LU-Factorization 


EXAMPLE 5 
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If A is ann x n matrix, then the following statements are equivalent. 


1. A is invertible. 

2. Ax = b has a unique solution for every n x 1 column matrix b. 
3. Ax = O has only the trivial solution. 

4. A is row-equivalent to /,. 

5. A can be written as the product of elementary matrices. 


The LU-Factorization 


Solving systems of linear equations is the most important application of linear algebra. At 
the heart of the most efficient and modern algorithms for solving linear systems, Ax = b is 
the so-called LU-factorization, in which the square matrix A is expressed as a product, 
A = LU. In this product, the square matrix L is lower triangular, which means all the 
entries above the main diagonal are zero. The square matrix U is upper triangular, which 
means all the entries below the main diagonal are zero. 


a, 0 0 A, 2 43 
4, 4, O O a Ay 
43; 439 433 0 0 433 
3 x 3 lower triangular matrix 3 x 3 upper triangular matrix 


By writing Ax = LUx and letting Ux = y, you can solve for x in two stages. First solve 
Ly = b for y; then solve Ux = y for x. Each system is easy to solve because the 
coefficient matrices are triangular. In particular, neither system requires any row operations. 


If the n x n matrix A can be written as the product of a lower triangular matrix L and an 
upper triangular matrix U, then A = LU is an LU-factorization of A. 


LU-Factorizations 


of aE Ik J-# 


1 2 
is an LU-factorization of the matrix A = F as the product of the lower 


0 


1 0 1 2 
triangular matrix L = 5 i and the upper triangular matrix U = — | 
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EXAMPLE 6 


i =% 0 1 0 oyf1 -3 
)A=/0 1 3/={0 1 offo 1 3]/=LU 
a iG, 2 2-4 1]lo o 14 


is an LU-factorization of the matrix A. 


If a square matrix A can be row reduced to an upper triangular matrix U using only the 
row operation of adding a multiple of one row to another row below it, then it is easy to 
find an LU-factorization of the matrix A. All you need to do is keep track of the individual 
row operations, as indicated in the example below. 


Finding the LU-Factorizations of a Matrix 


SOLUTION 


Lt =3 0 
Find the LU-factorization of the matrix A = | 0 | 3). 
2 —10 2 


Begin by row reducing A to upper triangular form while keeping track of the elementary 
matrices used for each row operation. 


Matrix Elementary Row Operation Elementary Matrix 
1 =3 0 1 0 0 
0 1 3 B=1:0 7 6 
0 -4 2 R, + (—2)R, > R; =2 0 1 
tL =3 0 1 0 0 
0 1 3 B=l6 1. 6 
0 O 14 R, + (4)R,>R; 0 4 1 


The matrix U on the left is upper triangular, and it follows that E,E,A = U, or 
A = E,'E,'U. Because the product of the lower triangular matrices 


l 6 O71 © O7 Jt oO © 
E,'E,'=|0 1 offo 1 of=]0 1. Oo 
2 0 1jlo -4 1) |2 -4 1 


is again a lower triangular matrix L, the factorization A = LU is complete. Notice that this 
is the same LU-factorization that is shown in Example 5(b) at the top of this page. 


In general, if A can be row reduced to an upper triangular matrix U using only the row 
operation of adding a multiple of one row to another row, then A has an LU-factorization. 


E,* + + E,E\A = U 
ASE Et 
A= LU 


-E,1U 


EXAMPLE 7 
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Here L is the product of the inverses of the elementary matrices used in the row reduction. 
Note that the multipliers in Example 6 are —2 and 4, which are the negatives of the 
corresponding entries in L. This is true in general. If U can be obtained from A using only 
the row operation of adding a multiple of one row to another row below, then the matrix L 
is lower triangular with 1’s along the diagonal. Furthermore, the negative of each multiplier 
is in the same position as that of the corresponding zero in U. 
Once you have obtained an LU-factorization of a matrix A, you can then solve the 
system of n linear equations in n variables Ax = b very efficiently in two steps. 
1. Write y = Ux and solve Ly = b for y. 
2. Solve Ux = y for x. 


The column matrix x is the solution of the original system because 
Ax = LUx = Ly = b. 


The second step in this algorithm is just back-substitution, because the matrix U is upper 
triangular. The first step is similar, except that it starts at the top of the matrix, because L is 
lower triangular. For this reason, the first step is often called forward substitution. 


Solving a Linear System Using LU-Factorization 


SOLUTION 


Solve the linear system. 


X,— 3x, = =5 
x, + 3x,= -1 
2x, — 10x, + 2x, = —20 


You obtained the LU-factorization of the coefficient matrix A in Example 6. 


lt -3 0 1 0 O;;1 —-3 0 
A= /0 1 3|=1]0 1 0)|0 1 3 
2 —10 2 2 -4 1}L0 


First, let y = Ux and solve the system Ly = b for y. 


1 0 Olly, =) 
0 1 Olly} =] -1 
2 —-4 1} Ly; —20 


This system is easy to solve using forward substitution. Starting with the first equation, you 
have y, = —5. The second equation gives y, = — 1. Finally, from the third equation, 
2y, — 4y, + 3 = —20 
y3 = —20 — 2y, + 4yy 
y3 = —20 — 2(-5) + 4(-1) 
y, = —14. 
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The solution of Ly = b is 


Now solve the system Ux = y for x using back-substitution. 


L =3 O} | x, =) 
0 1 3/|x,)=] —1 
0 0 14)Lx, —14 
From the bottom equation, x, = —1. Then, the second equation gives x, + 3(—1) = —1, 
or x, = 2. Finally, the first equation is x, — 3(2) = —5, or x, = 1. So, the solution of the 
original system of equations is 
1 
x= 2. |: 
=1 


ante) eae Exercises 


In Exercises 1—8, determine whether the matrix is elementary. If it 9. Find an elementary matrix E such that EA = B. 
is, state the elementary row operation used to produce it. 


10. Find an elementary matrix E such that EA = C. 


L F | 2, F 0 | 11. Find an elementary matrix E such that EB = A. 
0 2 0 0 1 12. Find an elementary matrix E such that EC = A. 
3. b | 4. F | In Exercises 13-20, find the inverse of the elementary matrix. 
2 0 0 0 0 n°] [59 
5/0 O 1 6|0 1 0 1 0 0 1 
0 1 0 2 0 1 0 0 1 1 0 0 
T 0 0 0 rT 0 0 0 15. f 1 0 16. c 1 0 
gics 2. -e 2 « 1 0 0 1 0 9 0-3 1 
0 —-5 1 0 0 0 1 0 k 0 0 
0 0 0 1 0 0 -3 1 17. ki | k#0 18. c 1 O|, kK#0 
In Exercises 9-12, let A, B, and C be 0 0 1 
- — 1 
se & Gala & 2h oa ee 
19. |0 0) 1 20. 
—1 2 0 1 2 =3 0 1 0 0 0) 1 0 
0 4 -3 0 0 0 1 
C=| 0 1 2). 
—1 2 0 


In Exercises 21-24, find the inverse of the matrix using elementary 
matrices. 


a, I A 2. li | 
1 0 ae | 
iL’ - @. i] i “<9 
10 6 =1 24./0 2 1 
0 Oo 4 0 0 1 


In Exercises 25-32, factor the matrix A into a product of elementary 
matrices. 


1 2 0 1 
sa-[! 2] eae 
4 -1 1 1 

na-[2 2 wa-[! 4] 
ft =2 0 1 2 3 
29. A =|-1 3 0 30. A =| 2 5 6 
0 0 1 1 3 a 
1 0 1 4 0 0 2 
0 -1 3 0 0 1 0 1 
31. A = 0 0 > 0 32. A = 0 0-1 3 
0 0 b= 1 0 0 -2 


True or False? In Exercises 33 and 34, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


33. (a) The identity matrix is an elementary matrix. 


(b) If E is an elementary matrix, then 2E is an elementary 
matrix. 


(c) The matrix A is row-equivalent to the matrix B if there exists 
a finite number of elementary matrices EF), E,,..., E, such 
thatA = E,E,_,° + * E,E\B. 
(d) The inverse of an elementary matrix is an elementary matrix. 
34. (a) The zero matrix is an elementary matrix. 


(b) A square matrix is nonsingular if it can be written as the 
product of elementary matrices. 
(c) Ax = O has only the trivial solution if and only if Ax = b 
has a unique solution for every n x 1 column matrix b. 
35. Writing £ is the elementary matrix obtained by interchanging 
two rows in /,. A is ann x n matrix. 


(a) How will EA compare with A? 
(b) Find E?. 


Section 2.4 Elementary Matrices 97 


36. Writing Eis the elementary matrix obtained by multiplying a 
row in J, by a nonzero constant c. A is ann X n matrix. 


(a) How will EA compare with A? 
(b) Find E?. 


37. Use elementary matrices to find the inverse of 


1 a O}} 1 0 O}} 1 0 0 
A=1|0 1 O||b 1 0/}|0 1 O|,c #0 
0 0 1} 0 0 1]}|0 0 c 


38. Use elementary matrices to find the inverse of 


1 0 0 
A=|0 1 0}, c#O0. 
a b c 


39. Writing Is the product of two elementary matrices always 
elementary? Explain why or why not and provide appropriate 
examples to illustrate your conclusion. 


40. Writing Is the sum of two elementary matrices always 
elementary? Explain why or why not and provide appropriate 
examples to illustrate your conclusion. 


In Exercises 41—44, find the LU-factorization of the matrix. 


41. | : | 42. ta ‘ 
=) | “6 4 
* 0 1 2 0 0 
4./ 6 1 1 44,| 0 —3% 1 
= 1 6 10 12 3 


In Exercises 45 and 46, solve the linear system Ax = b by 
(a) finding the LU-factorization of the coefficient matrix A, 
(b) solving the lower triangular system Ly = b, and 
(c) solving the upper triangular system Ux = y. 


45. xt+y = 1 

yrr= 2 

=2e + y + oS =2 
46. 2x, = 4 
=2%, + Ag = xy =—-4 
6x, + 2x, + x, = 15 
=%— = 1 


47. Writing Suppose you needed to solve many systems of 
linear equations Ax = b;, each having the same coefficient 
matrix A. Explain how you could use the LU-factorization 
technique to make the task easier, rather than solving each 
system individually using Gaussian elimination. 
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48. (a) Show that the matrix 
0 1 
a-[T ol 
1 0 
does not have an LU-factorization. 
(b) Find the LU-factorization of the matrix 
ae I: | 
Cc d 
that has 1’s along the main diagonal of L. Are there any 
restrictions on the matrix A? 


In Exercises 49-54, determine whether the matrix is idempotent. 
A square matrix A is idempotent if A? = A. 


wf 9 w[? 1 
0 0 1 0 
af? 3] ap 3 
Is 1 2 
0 0 1 0 1 0 
53. | 0 1 0 54. | 1 0 0 
1 0 0 0 0 1 


55. Determine a and b such that A is idempotent. 
1 0 
as a 
a b 
56. Determine conditions on a, b, and c such that A is idempotent. 
ae is | 
b c 
57. Prove that if A is an m x n matrix that is idempotent and 
invertible, then A = /,,. 


Stochastic Matrices 


Many types of applications involve a finite set of states {S,, S),. 


58. Guided Proof Prove that A is idempotent if and only if A7 is 
idempotent. 


Getting Started: The phrase “if and only if’ means that you 
have to prove two statements: 


1. If A is idempotent, then A’ is idempotent. 
2. If A’ is idempotent, then A is idempotent. 
(i) Begin your proof of the first statement by assuming 
that A is idempotent. 
(ii) This means that A? = A. 
(iii) Use the properties of the transpose to show that A? 
is idempotent. 
(iv) Begin your proof of the second statement by assum- 
ing that A’ is idempotent. 
59. Prove that if A and B are idempotent and AB = BA, then AB is 
idempotent. 


60. Prove that if A is row-equivalent to B, then B is row-equivalent 
to A. 

61. Guided Proof Prove that if A is row-equivalent to B and B is 
row-equivalent to C, then A is row-equivalent to C. 


Getting Started: To prove that A is row-equivalent to C, 


you have to find elementary matrices E£,,. . ., £, such that 
A= Epos + B,C. 
(i) Begin your proof by observing that A is row-equivalent 
to B. 
(ii) Meaning, there exist elementary matrices F,. . ., F, 


such that A = F- : - FB. 

(iii) There exist elementary matrices G,,. . 
B=G,: + °G,C. 

(iv) Combine the matrix equations from steps (ii) and (iii). 


.,G, such that 


m 


62. Let A be a nonsingular matrix. Prove that if B is row-equivalent 
to A, then B is also nonsingular. 


2.5 | Applications of Matrix Operations 


..,S,} of a given 


population. For instance, residents of a city may live downtown or in the suburbs. Voters 
may vote Democrat, Republican, or for a third party. Soft drink consumers may buy 
Coca-Cola, Pepsi Cola, or another brand. 
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The probability that a member of a population will change from the jth state to the ith 
state is represented by a number p,;, where 0 < p,; < 1. A probability of p;; = 0 means that 
the member is certain not to change from the jth state to the ith state, whereas a probabil- 
ity of p;, = 1 means that the member is certain to change from the jth state to the ith state. 


From 
S Sa 4.0% 
Pu Piz °°) Pin {51 
p= Pai P22 aa P2n = To 
Pri Pr2 a Pan Si 


P is called the matrix of transition probabilities because it gives the probabilities of each 
possible type of transition (or change) within the population. 

At each transition, each member in a given state must either stay in that state or change 
to another state. For probabilities, this means that the sum of the entries in any column of 
P is 1. For instance, in the first column we have 


Put Pa tess + Py = 1. 


In general, such a matrix is called stochastic (the term “stochastic” means “regarding 
conjecture”). That is, an n x n matrix P is called a stochastic matrix if each entry is a 
number between 0 and | and each column of P adds up to 1. 


EXAMPLE 1| Examples of Stochastic Matrices and Nonstochastic Matrices 


The matrices in parts (a) and (b) are stochastic, but the matrix in part (c) is not. 


1 0 0 > & & 0.1 02 03 
@lo 1 0 @ii o 4 «)/02 03 04 
0 0 1 1 2 4g 03 04 05 


EXAMPLE 2 A Consumer Preference Model 


Two competing companies offer cable television service to a city of 100,000 households. 
The changes in cable subscriptions each year are shown in Figure 2.1. Company A now has 
15,000 subscribers and Company B has 20,000 subscribers. How many subscribers will 
each company have | year from now? 


SOLUTION 


Figure 2.1 


The matrix representing the given transition probabilities is 
From 


J 
A B- None 


0.70 0.15 0.15] , 
P=|0.20 0.80 0.15]B  }70 
0.10 0.05 0.70} None 


and the state matrix representing the current populations in the three states is 


15,000 A 
X = | 20,000 }. B 
65,000 None 


To find the state matrix representing the populations in the three states after one year, 
multiply P by X to obtain 


0.70 0.15 0.15] ] 15,000 23,250 
PX =/|0.20 0.80 0.15} | 20,000 | = | 28,750 }. 
0.10 0.05 0.70] 65,000 48,000 


After one year, Company A will have 23,250 subscribers and Company B will have 28,750 
subscribers. 


One of the appeals of the matrix solution in Example 2 is that once the model has been 
created, it becomes easy to find the state matrices representing future years by repeatedly 
multiplying by the matrix P. This process is demonstrated in Example 3. 
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EXAMPLE 3 A Consumer Preference Model 


Assuming the matrix of transition probabilities from Example 2 remains the same year 
after year, find the number of subscribers each cable television company will have after 
(a) 3 years, (b) 5 years, and (c) 10 years. (The answers in this example have been rounded 
to the nearest person.) 


SOLUTION (a) From Example 2 you know that the number of subscribers after 1 year is 


23,250 A 
PX = | 28,750 |. B After 1 year 
48,000 None 


Because the matrix of transition probabilities is the same from the first to the third year, 
the number of subscribers after 3 years is 


30,283 A 
P?X = | 39,042 |. B After 3 years 
30,675 None 


After 3 years, Company A will have 30,283 subscribers and Company B will have 
39,042 subscribers. 
(b) The number of subscribers after 5 years is 


32,411 A 
P°X = | 43,812}. B After 5 years 
23,777 None 


After 5 years, Company A will have 32,411 subscribers and Company B will have 
43,812 subscribers. 
(c) The number of subscribers after 10 years is 


33,287 A 
P!°X = | 47,147]. B After 10 years 
19,566 None 


After 10 years, Company A will have 33,287 subscribers and Company B will have 
47,147 subscribers. 


In Example 3, notice that there is little difference between the numbers of subscribers 
after 5 years and after 10 years. If the process shown in this example is continued, the 
numbers of subscribers eventually reach a steady state. That is, as long as the matrix P 
doesn’t change, the matrix product P”X approaches a limit X. In this particular example, the 
limit is the steady state matrix 


33,333 A 
X = | 47,619 |. B Steady state 
19,048 None 


You can check to see that PX = X. 
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EXAMPLE 4 


Cryptography 


A cryptogram is a message written according to a secret code (the Greek word kryptos 
means “hidden’”). This section describes a method of using matrix multiplication to encode 
and decode messages. 

Begin by assigning a number to each letter in the alphabet (with 0 assigned to a blank 
space), as follows. 


0=_ 14=N 
1=A 15=0 
2=B 16=P 
3=C 17=Q 
4=D 18=R 
5=E 19=S 
6=F 2=T 
7=G 21=U 
8=H 22=V 
9=I 23=W 
10=J 24=xX 
11=K 25=Y 
122=L 2=Z 
13=M 


Then the message is converted to numbers and partitioned into uncoded row matrices, 
each having n entries, as demonstrated in Example 4. 


Forming Uncoded Row Matrices 


SOLUTION 


Write the uncoded row matrices of size 1 x 3 for the message MEET ME MONDAY. 


Partitioning the message (including blank spaces, but ignoring punctuation) into groups of 
three produces the following uncoded row matrices. 


(13 5 5] (20 O 13) [5 O 13] [15 14 4] [1 25 0] 
MEET — ME _MO -N DA Y 


Note that a blank space is used to fill out the last uncoded row matrix. 


To encode a message, choose ann x n invertible matrix A and multiply the uncoded row 
matrices (on the right) by A to obtain coded row matrices. This process is demonstrated in 
Example 5. 
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EXAMPLE 5| _ Encoding a Message 


Use the matrix 


I =2 2 
A= |-1 1 3 
1 =1 =4 


to encode the message MEET ME MONDAY. 


SOLUTION  Thecoded row matrices are obtained by multiplying each of the uncoded row matrices found 
in Example 4 by the matrix A, as follows. 


Uncoded Encoding Coded Row 
Row Matrix Matrix A Matrix 
lt =2 2 
[13 5 5] -1 1 3 = [13 —26 21] 
1 -l —-4 
1 -2 2 
[20 0 13] -1 1 ec} = [33 —53 —12] 
1 -l —-4 
1 -2 2 
[5 0 13] -1 1 3|= [18 —23 —42] 
1 -l —-4 
{| =2 2 
[15 14 4] —1 1 3 =([5 —20 56] 
1 -l —-4 
I =2 2 
[1 25 0] —1 1 3 =[-24 23 77| 
1 -l —-4 


The sequence of coded row matrices is 
[13 —26 21][33 —53 —12][18 —23 —42][5 —20 56][—-24 23 77]. 
Finally, removing the brackets produces the cryptogram below. 


13 —26 21 33 —53 —-12 18 —23 —42 5 -—20 56 —24 23 77 


For those who do not know the matrix A, decoding the cryptogram found in Example 5 
is difficult. But for an authorized receiver who knows the matrix A, decoding is simple. The 
receiver need only multiply the coded row matrices by A™! to retrieve the uncoded row 
matrices. In other words, if 


X= [x, Xo aa 
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EXAMPLE 6 


is an uncoded | x n matrix, then Y = XA is the corresponding encoded matrix. The 
receiver of the encoded matrix can decode Y by multiplying on the right by A~! to obtain 


YA-! = (XA)A-! = X 


This procedure is demonstrated in Example 6. 


Decoding a Message 


lay 


Simulation 

Explore this concept further with an 
electronic simulation available on 
the website college.hmco.con/ 
pic/larsonELA6e. 


SOLUTION 


Use the inverse of the matrix 


1 =2 Z 
A=|-1 1 3 
1 -l —-4 
to decode the cryptogram 
13 -—26 21 33 -—53 -12 18 -—23 —-42 5 —-20 56 —24 23 77. 
Begin by using Gauss-Jordan elimination to find A~!. 
[A : 7] [tA] 
1 =2 2 2 I> 20. 0 1 0 0 : -1 -10 -8 
-l 1 3 : 0 1 O}| —» |]0 1 0 : -1 -6 —5 
1 -1l -4 0 O 1 0 oO 1 0 =1 =! 


Now, to decode the message, partition the message into groups of three to form the coded 
row matrices 


[13 —26 21][33 —53 —12][18 —23 —42][5 —20 56][-24 23 77]. 
To obtain the decoded row matrices, multiply each coded row matrix by A~! (on the right). 
Coded Row Decoding Decoded 
Matrix Matrix A~! Row Matrix 
=1 =10 =8 
[13 —26 21] : 5] =[13 5 5] 
0 =1 
=]. =—10' =8 
[33 —53 —12] 1 : 5| = [20 0 13] 
0 =] 
=]. =—10. =8 
[18 —23 —42] 1 6 5| =[5 0 13] 
0 =] 
=] =10 =8 
[5 —20 56] 6 5}/=[15 14 4] 
=] 
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Coded Row Decoding Decoded 
Matrix Matrix A~! Row Matrix 
—-1 -10 -8 
[-24 23 77] 1 6 5}/=[1 25 0] 
Q =-1 =I 


The sequence of decoded row matrices is 
[13 ) 5] [20 0 1/6 0 13)[15 14 4|[1 25 0] 
and the message is 


13 > 5 “20 0 13 5 
M E E T M E M O 


Leontief Input-Output Models 


Matrix algebra has proved effective in analyzing problems concerning the input and output 
of an economic system. The model discussed here, developed by the American economist 
Wassily W. Leontief (1906-1999), was first published in 1936. In 1973, Leontief was 
awarded a Nobel prize for his work in economics. 

Suppose that an economic system has n different industries J,, /,,. . ., J,,, each of which 
has input needs (raw materials, utilities, etc.) and an output (finished product). In produc- 
ing each unit of output, an industry may use the outputs of other industries, including itself. 
For example, an electric utility uses outputs from other industries, such as coal and water, 
and even uses its own electricity. 

Let d;; be the amount of output the jth industry needs from the ith industry to produce 
one unit of output per year. The matrix of these coefficients is called the input-output 


matrix. 


User (Output) 
a , 
dy, dp dy, | 1, 
d d eer. dss dy 
pa eS mal Ny Supplier (Input) 
dy dj dan I, 


To understand how to use this matrix, imagine d,, = 0.4. This means that 0.4 unit of 
Industry 1’s product must be used to produce one unit of Industry 2’s product. If d,, = 0.2, 
then 0.2 unit of Industry 3’s product is needed to produce one unit of its own product. For 
this model to work, the values of d;; must satisfy 0 < d;; < 1 and the sum of the entries in 
any column must be less than or equal to 1. 
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EXAMPLE 7 


Forming an Input-Output Matrix 


SOLUTION 


Consider a simple economic system consisting of three industries: electricity, water, and 
coal. Production, or output, of one unit of electricity requires 0.5 unit of itself, 0.25 unit of 
water, and 0.25 unit of coal. Production, or output, of one unit of water requires 0.1 unit of 
electricity, 0.6 unit of itself, and 0 units of coal. Production, or output, of one unit of coal 
requires 0.2 unit of electricity, 0.15 unit of water, and 0.5 unit of itself. Find the input-output 
matrix for this system. 


The column entries show the amounts each industry requires from the others, as well as from 
itself, in order to produce one unit of output. 
User (Output) 


a ra. 
E W Cc 


0.5 O01 O02} 2 
0.25 0.6 O15] Ww Supplier (Input) 
0.25 0 0.5 | Cc 


The row entries show the amounts each industry supplies to the other industries, as well 
as to itself, in order for that particular industry to produce one unit of output. For instance, 
the electricity industry supplies 0.5 unit to itself, 0.1 unit to water, and 0.2 unit to coal. 


To develop the Leontief input-output model further, let the total output of the ith indus- 
try be denoted by x,. If the economic system is closed (meaning that it sells its products 
only to industries within the system, as in the example above), then the total output of the 
ith industry is given by the linear equation 


XH, = dyx, + dix, t+ +++ d,,x Closed system 


L inn 


On the other hand, if the industries within the system sell products to nonproducing 
groups (such as governments or charitable organizations) outside the system, then the 
system is called open and the total output of the ith industry is given by 


X= dy% + djgXy to + + dx, + e;, Open system 


l inn 


where e; represents the external demand for the ith industry’s product. The collection 
of total outputs for an open system is represented by the following system of n linear 
equations. 


x, = yx, + dypox, +--+ + d,,x, + e 
xy = yX, + dyX, +++ ++ dx, + ey 
x, dX) + dX > Steet tate dn Xn at en 


The matrix form of this system is 
X= DX +E, 


where X is called the output matrix and E is called the external demand matrix. 


EXAMPLE 8 
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Solving for the Output Matrix of an Open System 


SOLUTION 


An economic system composed of three industries has the input-output matrix shown below. 


User (Output) 
A B Cc 

0.1 0.43 0 ‘x 

D=|015 0 0.37 |B | Supplier (Input) 
0.23 0.03 0.02 | © 

Find the output matrix X if the external demands are 

20,000 * 

E = | 30,000 |. B 
25,000 = 


(The answers in this example have been rounded to the nearest unit.) 


Letting J be the identity matrix, write the equation X = DX + E as IX — DX = E, which 
means 
(I-— D)X = E. 
Using the matrix D above produces 
0.9 — 0.43 0 


I-D=|-0.15 1 —0.37 |. 
—0.23 —0.03 0.98 


Finally, applying Gauss-Jordan elimination to the system of linear equations represented by 
(I — D)X = E produces 


0.9 — 0.43 0 20,000 1 0 O 46,616 
—0.15 1 —0.37 30,000} == |0 I O 51,058). 
—0.23 —0.03 0.98 25,000 0 O I 38,014 


So, the output matrix is 


46,616 A 
X = | 51,058 |}. B 
38,014 C 


To produce the given external demands, the outputs of the three industries must be as 
follows. 

Output for Industry A: 46,616 units 

Output for Industry B: 51,058 units 

Output for Industry C: 38,014 units 
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EXAMPLE 9 


The economic systems described in Examples 7 and 8 are, of course, simple ones. In the 
real world, an economic system would include many industries or industrial groups. For 
example, an economic analysis of some of the producing groups in the United States would 
include the products listed below (taken from the Statistical Abstract of the United States). 


1. Farm products (grains, livestock, poultry, bulk milk) 
2. Processed foods and feeds (beverages, dairy products) 
3. Textile products and apparel (yarns, threads, clothing) 
4. Hides, skins, and leather (shoes, upholstery) 
5. Fuels and power (coal, gasoline, electricity) 
6. Chemicals and allied products (drugs, plastic resins) 
7. Rubber and plastic products (tires, plastic containers) 
8. Lumber and wood products (plywood, pencils) 
9. Pulp, paper, and allied products (cardboard, newsprint) 
10. Metals and metal products (plumbing fixtures, cans) 
11. Machinery and equipment (tractors, drills, computers) 
12. Furniture and household durables (carpets, appliances) 
13. Nonmetallic mineral products (glass, concrete, bricks) 
14. Transportation equipment (automobiles, trucks, planes) 
15. Miscellaneous products (toys, cameras, linear algebra texts) 
A matrix of order 15 x 15 would be required to represent even these broad industrial 
groupings using the Leontief input-output model. A more detailed analysis could easily 
require an input-output matrix of order greater than 100 x 100. Clearly, this type of analy- 
sis could be done only with the aid of a computer. 


Least Squares Regression Analysis 
You will now look at a procedure that is used in statistics to develop linear models. The next 


example demonstrates a visual method for approximating a line of best fit for a given set of 
data points. 


A Visual Straight-Line Approximation 


SOLUTION 


Determine the straight line that best fits the points. 

(1, 1), (2, 2), (3, 4), (4,4), and (5, 6) 
Plot the points, as shown in Figure 2.2. It appears that a good choice would be the line whose 
slope is 1 and whose y-intercept is 0.5. The equation of this line is 


y=05+x. 


An examination of the line shown in Figure 2.2 reveals that you can improve the fit 
by rotating the line counterclockwise slightly, as shown in Figure 2.3. It seems clear that 
this new line, the equation of which is y = 1.2x, fits the given points better than the 
original line. 


6+ Model 1 (5, 6)@ 


Figure 2.4 


Section 2.5 Applications of Matrix Operations 109 


Figure 2.2 Figure 2.3 


One way of measuring how well a function y = f(x) fits a set of points 


(x, yi)s (x>, Yo), a) (x,,, y,) 


is to compute the differences between the values from the function f(x,) and the actual 
values y;, as shown in Figure 2.4. By squaring these differences and summing the results, 
you obtain a measure of error that is called the sum of squared error. The sums of squared 
errors for our two linear models are shown in Table 2.1 below. 


TABLE 2.1 

Model 1: f(x) = 0.5 + x Model 2: f(x) = 1.2x 
x; Yi F%;) 

1 1 1.5 

2 2 2.5 

3 4 3.5 

4 4 4.5 

5 6 33 

Total 


The sums of squared errors confirm that the second model fits the given points better than 
the first. 

Of all possible linear models for a given set of points, the model that has the best fit is 
defined to be the one that minimizes the sum of squared error. This model is called the least 
squares regression line, and the procedure for finding it is called the method of least 
squares. 
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Definition of Least 
Squares Regression Line 


For a set of points (x,, y,), (%, y2),- - -,(%,,y,), the least squares regression line is 
given by the linear function 


f(x) = ay + ayx 
that minimizes the sum of squared error 


Ly =F) Ar Ly. = fo) le fiancee Lyn =f) 


To find the least squares regression line for a set of points, begin by forming the system 
of linear equations 


y, = fx) + Ly — f)] 
Yo = f(x.) ag Ly =F (x5)] 


Yn = f@,) + Dy, — F&I 


where the right-hand term, [ y, — f(x,)], of each equation is thought of as the error in the 
approximation of y, by f(x;). Then write this error as 


e; = yi — f(x) 

so that the system of equations takes the form 
V1 = (dy + ax,) + e; 
Yq = (dy + a,X,) + e, 


y, = (ay + ayx,) + @,. 


Now, if you define Y, X, A, and E as 


aT x) e 

Y= y2 X= | aan a=|%| E= €2 
: ay . 

Yn 1 x é, 


the n linear equations may be replaced by the matrix equation 
Y=XA+E. 


Note that the matrix X has two columns, a column of 1’s (corresponding to a,)) and a 
column containing the x,’s. This matrix equation can be used to determine the coefficients 
of the least squares regression line, as follows. 
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Matrix Form for 
Linear Regression 


REMARK: You will learn more about this procedure in Section 5.4. 


Example 10 demonstrates the use of this procedure to find the least squares regression 
line for the set of points from Example 9. 


EXAMPLE 10| Finding the Least Squares Regression Line 


Find the least squares regression line for the points (1, 1), (2, 2), (3, 4), (4, 4), and (5, 6) 
(see Figure 2.5). Then find the sum of squared error for this regression line. 


SOLUTION Using the five points below, the matrices X and Y are 


1 1 1 
1 2 2 
X= {1 3 and Y=| 4}. 
1 4 4 
1 5 6 
This means that 
1 1 
1 2 
1 11 i1éi1 5 15 
ee 1 3 -| 
y 123 4 5 1 4 15 55 
1 2) 
and 
1 
2 
1 11 1éi1 17 
Ty = — 
eal oa 4 sll | Le 
A 
6 


Least Squares Regression Line 


Figure 2.5 


45) 7. 


oF) 8. 
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Now, using (X7X)~! to find the coefficient matrix A, you have 


4 55 | es ee 
1-15 5} | 63 1.2\ 


The least squares regression line is 


A = (XTX)“1XTY = 


y = —0.2 + 1.2x. 


(See Figure 2.5.) The sum of squared error for this line can be shown to be 0.8, which 
means that this line fits the data better than either of the two experimental linear models 


determined earlier. 


ane) eee Exercises 


Stochastic Matrices 


In Exercises 1-6, determine whether the matrix is stochastic. 


2 2 v2 V2 

5 5 2 2 
1. 2. 

3 7 2 2 

5 5 — ee 2 

0 1 0 03 01 08 
3./0 O 1 4.105 02 0.1 

1 oO 0 0.2 0.7 O.1 

1 1 1 

bad 2. 
5 il 2 1 6 

: : Fi 0 oOo 1 0 

3 6 2 0 0 oO 1 


The market research department at a manufacturing plant 
determines that 20% of the people who purchase the plant’s 
product during any month will not purchase it the next month. 
On the other hand, 30% of the people who do not purchase the 
product during any month will purchase it the next month. In a 
population of 1000 people, 100 people purchased the product 
this month. How many will purchase the product next month? In 
2 months? 

A medical researcher is studying the spread of a virus in a 
population of 1000 laboratory mice. During any week there is an 
80% probability that an infected mouse will overcome the virus, 
and during the same week there is a 10% probability that a 
noninfected mouse will become infected. One hundred mice are 
currently infected with the virus. How many will be infected next 
week? In 2 weeks? 


a) 9, 


45) 10. 


49) 11. 


A population of 10,000 is grouped as follows: 5000 nonsmokers, 
2500 smokers of one pack or less per day, and 2500 smokers of 
more than one pack per day. During any month there is a 5% 
probability that a nonsmoker will begin smoking a pack or 
less per day, and a 2% probability that a nonsmoker will begin 
smoking more than a pack per day. For smokers who smoke a 
pack or less per day, there is a 10% probability of quitting and a 
10% probability of increasing to more than a pack per day. For 
smokers who smoke more than a pack per day, there is a 5% 
probability of quitting and a 10% probability of dropping to a 
pack or less per day. How many people will be in each of the 
3 groups in 1 month? In 2 months? 


A population of 100,000 consumers is grouped as follows: 
20,000 users of Brand A, 30,000 users of Brand B, and 50,000 
who use neither brand. During any month a Brand A user has a 
20% probability of switching to Brand B and a 5% probability 
of not using either brand. A Brand B user has a 15% proba- 
bility of switching to Brand A and a 10% probability of not 
using either brand. A nonuser has a 10% probability of purchas- 
ing Brand A and a 15% probability of purchasing Brand B. How 
many people will be in each group in | month? In 2 months? In 
3 months? 


A college dormitory houses 200 students. Those who watch an 
hour or more of television on any day always watch for less than 
an hour the next day. One-fourth of those who watch television 
for less than an hour one day will watch an hour or more the next 
day. Half of the students watched television for an hour or more 
today. How many will watch television for an hour or more 
tomorrow? In 2 days? In 30 days? 


8) 12. 


13. 


14. 


For the matrix of transition probabilities 
0.6 0.1 O1 

P=|02 0.7 O14, 
0.2 0.2 0.8 

find P?X and P°X for the state matrix 
100 

X =| 100). 
800 


Then find the steady state matrix for P. 

Prove that the product of two 2 x 2 stochastic matrices is 
stochastic. 

Let P be a 2 x 2 stochastic matrix. Prove that there exists a 
2 x 1 state matrix X with nonnegative entries such that PX = X. 


Cryptography 


In Exercises 15—18, find the uncoded row matrices of the indicated 
size for the given messages. Then encode the message using the 


matrix A. 
15. Message: SELL CONSOLIDATED 
Row Matrix Size: 1 x 3 
1 -1 0 
Encoding Matrix: A = 1 QO =! 
—6 2 3 
16. Message: PLEASE SEND MONEY 
Row Matrix Size: 1 x 3 
4 2 1 
Encoding Matrix: A=|—-3 —-3 —1 
3 2 1 


17. 


18. 


Message: COME HOME SOON 


Row Matrix Size: 1 x 2 


1 2 
Encoding Matrix: A = | 
3 5 


Message: HELP IS COMING 
Row Matrix Size: 1 x 4 


Encoding Matrix: A = 
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In Exercises 19-22, find A~! and use it to decode the cryptogram. 


wa-[! 3] 
3 =) 


20. 


21. 


22. 


23. 


24. 


4b) 25. 


11 21 64 112 25 50 29 53 23 46 40 75 55 92 


2 
a 
3 4 


85 120 6 8 10 15 84 117 42 56 90 125 60 80 30 
45 19 26 


-1 -4 -7 
13 19 10 -1 —33 
-47 41 -9 

3-4 2 


VES =2. —14 4 1 =9: 5. =25 


A= 1/0 2 1], 


4 -5 3 


112 —140 83 19 —25 13 72 —76 61 95 —118 71 20 21 
38 35 —23 36 42 —48 32 


The cryptogram below was encoded with a 2 x 2 matrix. 


8 21 —15 -—10 -—13 -13 5 10 5 25 5 19 —1 6 20 40 
—18 —18 1 16 


The last word of the message is __ RON. What is the message? 
The cryptogram below was encoded with a 2 x 2 matrix. 


5°2..25 11 =2 —7 =15 —15. 32 14 —8 =—13 38 19=19 
—19 37 16 


The last word of the message is _ SUE. What is the message? 


Use a graphing utility or computer software program with 
matrix capabilities to find A~!. Then decode the cryptogram. 


1 0 2 
A=|2 —1 1 
Oo tlt 2 


38 —14 29 56 —15 62 17 3 38 18 20 76 18 —5 21 29 
—7 32 32 9 77 36 —8 48 33 —5 51 41 3 79 12 1 26 
58 —22 49 63 —19 69 28 8 67 31 —11 27 41 —18 28 
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26. A code breaker intercepted the encoded message below. 


45 —35 38 —30 18 —18 35 —30 81 —60 42 —28 75 
55 2 2 22 —21 15 —-10 
Let A7! = |" ‘| 
y Zz 
(a) You know that [45 — 35]A~! = [10 15] and 


[38 — 30]A~! =[8 14], where A~! is the inverse of 
the encoding matrix A. Write and solve two systems of 
equations to find w, x, y, and z. 


(b) Decode the message. 


Leontief Input-Output Models 


27. A system composed of two industries, coal and steel, has the 
following input requirements. 


(a) To produce $1.00 worth of output, the coal industry 
requires $0.10 of its own product and $0.80 of steel. 

(b) To produce $1.00 worth of output, the steel industry 
requires $0.10 of its own product and $0.20 of coal. 


Find D, the input-output matrix for this system. Then solve for 
the output matrix X in the equation X = DX + E, where the 
external demand is 


E= Beeal 
20,000 
28. An industrial system has two industries with the following input 
requirements. 
(a) To produce $1.00 worth of output, Industry A requires 
$0.30 of its own product and $0.40 of Industry B’s 
product. 
(b) To produce $1.00 worth of output, Industry B requires 


$0.20 of its own product and $0.40 of Industry A’s 
product. 


Find D, the input-output matrix for this system. Then solve for 
the output matrix X in the equation X = DX + E, where the 
external demand is 


_ peal 
30,000" 


oy) 29. A small community includes a farmer, a baker, and a grocer and 


has the input-output matrix D and external demand matrix EF 
shown below. 


Farmer Baker Grocer 
0.40 0.50 0.50} Farmer 1000 
D= {0.30 0.00 0.30} Baker and E =} 1000 
0.20 0.20 0.00} Grocer 1000 


Solve for the output matrix X in the equation X = DX + E. 


30. An industrial system has three industries and the input-output 
matrix D and external demand matrix E shown below. 


0.2 04 0.4 5000 
D=/04 0.2 0.2} and E =} 2000 
0.0 0.2 0.2 8000 


Solve for the output matrix X in the equation X = DX + E. 
Least Squares Regression Analysis 


In Exercises 31—34, (a) sketch the line that appears to be the best fit 
for the given points, (b) use the method of least squares to find the 
least squares regression line, and (c) calculate the sum of the 
squared error. 


31. ; 32. y 
4+ 4 
st @3), 3+ 3.2) 
isi 2 e 
=a "ve + @(1,1) 
a 
(—2, 0) '%0, 1) (-3, 0)-1 1 2.3 
a io -24 
33. y 34. 
440.4) at (5, 2) 
3+ (4, 2) (6, 2) 
ey ca) ota BON \ d 
27 yy ) e e—(4, 1) 
Kk @ ooo} ek 
(1,1) (2,0) ee 29 
| eee o£ (2,0) 3,0) 
-l 1 2 3 = 


49) In Exercises 35-42, find the least squares regression line. 


35. 
36. 
37. 
38. 
39. 
40. 
41. 
42. 


(0, 0), (1, 1), (2, 4) 

(1, 0), (3, 3), (5, 6) 

(—2, 0), (-1, 1), (0, 1), (1, 2) 

(—4, —1), (2, 0), (2, 4), (4, 5) 
(—5, 1), (1, 3), (2, 3), (2, 5) 

(—3, 4), (-1, 2), (, 1), (3, 0) 

(—5, 10), (—1, 8), (3, 6), (7, 4), (5, 5) 
(0, 6), (4, 3), (5, 0), (8, —4), (10, —5) 


&e) 43. A fuel refiner wants to know the demand for a certain grade of 
gasoline as a function of the price. The daily sales y (in gallons) 
for three different prices of the product are shown in the table. 


Price (x) $3.00 $3.25 $3.50 


Demand (y) 4500 3750 3300 


(a) Find the least squares regression line for these data. 
(b) Estimate the demand when the price is $3.40. 


5) 44. 


A hardware retailer wants to know the demand for a recharge- 
able power drill as a function of the price. The monthly sales for 
four different prices of the drill are shown in the table. 


Price (x) $25 $30 $35 $40 


Demand (y) 82 75 67 55 


(a) Find the least squares regression line for these data. 
(b) Estimate the demand when the price is $32.95. 


. The table shows the numbers y of motor vehicle registrations 
(in millions) in the United States for the years 2000 through 
2004. (Source: U.S. Federal Highway Administration) 


Year 2000 2001 2002 2003 2004 


Number (y) 


221.5 2304 2296 2314 237.2 
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(a) Use the method of least squares to find the least squares 
regression line for the data. Let f represent the year, 
with t = 0 corresponding to 2000. 

(b) Use the linear regression capabilities of a graphing 
utility to find a linear model for the data. Let t represent 
the year, with t = 0 corresponding to 2000. 


43) 46. A wildlife management team studied the reproduction rates of 
deer in 3 tracts of a wildlife preserve. Each tract contained 
5 acres. In each tract the number of females x and the percent of 
females y that had offspring the following year were recorded. 
The results are shown in the table. 


Number (x) 100 120 140 


Percent (y) 75 68 55 


(a) Use the method of least squares to find the least squares 
regression line that models the data. 

(b) Use a graphing utility to graph the model and the data 
in the same viewing window. 

(c) Use the model to create a table of estimated values of y. 
Compare the estimated values with the actual data. 

(d) Use the model to estimate the percent of females that 
had offspring when there were 170 females. 

(e) Use the model to estimate the number of females when 
40% of the females had offspring. 
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In Exercises 1—6, perform the indicated matrix operations. 


asl? 1 Weep 3 =a 
0 5-4 OFZ 5 


1 2 7 1 
2. -2)5  —4]/+4+ 8 1 2 
6 0 1 4 

1 2 
6: = 8 

3.|5 -4|| 


0 3] 0 0 2 


«le alls altlo al 


In Exercises 7-10, write out the system of linear equations 
represented by the matrix equation. 


mL blll 
«Ls albl-L-2 
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0 1 -21[x, -1 
%|-1 3 I}lx}/=| 0 
2-2 AJL, 2 
0 -1 ie 0 
10./3 2 Ily|=]-1 
4 -3 -4]l<z -7 


In Exercises 11-14, write the system of linear equations in matrix 
form. 


11. 2x- y= 5 12, 26 y= =8 
3x + 2y = —4 x+4y=-4 

13. 2x, + 3x, + x, = 10 14. —3x, X x3= O 
2X, = 3X5 = 3x4 = 22 2x, + 4x, — 5x, = —3 


4x, — 2x, + 3x, = —2 x, — 2X + 3x, = 1 


In Exercises 15—18, find A’, A7A, and AA’. 
1 2 = —1 
wf 23) eB 
0) 1 2 2 0 
16; fi. 2° 33] 


17. 3 


In Exercises 19-22, find the inverse of the matrix (if it exists). 


19. | “1 Bes | 
| =— 3 
t at tf 4 
2 f 4 
0 1 1 1 
ai.|9 <3 23 22 
. a 4 0 0 1 1 
0 0 0 1 


In Exercises 23— 26, write the system of linear equations in the form 
Ax = b. Then find A~! and use it to solve for x. 


23. 5x, +4x,= 2 24, 3x, + 2x, = 
Hy 5 S22 x, + 4x, = —3 

25, =x, Xm + 2h, 1 26. %, +X, + 2x, 
2x, + 3x, X= 2. Se A oe | 
5x, + 4x, +2x,= 4 2x, + x, x3 


In Exercises 27 and 28, find A. 


27. (3A)-! = b ‘| 


—_ 28. ea) =[5 x 


In Exercises 29 and 30, find x such that the matrix A is nonsingular. 


3 1 2 x 
29. A = ; A= 
be a ” ki | 


In Exercises 31 and 32, find the inverse of the elementary matrix. 


1 0 4 1 0 0 
31. | 0 1 0 32. | 0 6 0 
0 0 1 0 0 1 


In Exercises 33-36, factor A into a product of elementary matrices. 


33.4=[5 | ua=[") 4 


0 1 Ar <n 
1 0 1 3 0 6 
35.A=|0 1 —-2 36.A=|0 2 O 
0 0 4 1 0 3 


37. Find two 2 x 2 matrices A such that A? = J. 

38. Find two 2 x 2 matrices A such that A? = O. 

39. Find three 2 x 2 matrices A such that A? = A. 

40. Find 2 x 2 matrices A and B such that AB = O but BA # O. 


In Exercises 41 and 42, let the matrices X, Y, Z, and W be 


1 -1 3 3 
2 0 4 2 
x= |" |. %= | Ze , WH 
0 3 -1 -4 
1 2 2 -1 


41. (a) Find scalars a, b, and c such that W = aX + bY + cZ. 
(b) Show that there do not exist scalars a and b such that 
Z = aX + bY. 


42. Show that if aX + bY + cZ = O, thena =b=c=0. 

43. Let A,B, and A+B be nonsingular matrices. Prove that 
A! + B~'is nonsingular by showing that 
(A-! + B-!)-! =A(A + B)7'B. 

44, Writing Let A, B, and C be n x n matrices and let C be non- 
singular. If AC = CB, is it true that A = B? If so, prove it. 


If not, explain why and find an example for which the 
hypothesis is false. 


In Exercises 45 and 46, find the LU-factorization of the matrix. 


7 5 1 1 1 
45. | | 46. | 1 2 
6 14 
1 2 3 


In Exercises 47 and 48, use the LU-factorization of the coefficient 
matrix to solve the linear system. 


47. 


48. 


x a Soe 
2x yt+2z=7 
3x + 2y + 6z = 8 
2x, X5 X; Xg= 7 
Bho Xe ky = 3 
—2x, = 2 
2X, X5 Xe 2h = 8 


True or False? In Exercises 49—52, determine whether each state- 
ment is true or false. If a statement is true, give a reason or cite an 
appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite 
an appropriate statement from the text. 


49. 


50. 


51. 


52. 


53. 


(a) Addition of matrices is not commutative. 


(b) The transpose of the sum of matrices is equal to the sum of 
the transposes of the matrices. 


(a) The product of a2 x 3 matrix anda3 x 5 matrix is a matrix 
that is 5 x 2. 


b) The transpose of a product is equal to the product of trans- 
Pp p q p 
poses in reverse order. 


(a) Alln x n matrices are invertible. 


(b) If an n X n matrix A is not symmetric, then A7A is not 
symmetric. 


(a) If A and B are n x n matrices and A is invertible, then 
(ABA~!)? = AB?A7!. 

(b) If A and B are nonsingular n x n matrices, then A + Bisa 
nonsingular matrix. 


At a convenience store, the numbers of gallons of 87 octane, 
89 octane, and 93 octane gasoline sold on Friday, Saturday, and 
Sunday of a particular holiday weekend are shown by the 
matrix. 


87 89 93 
Friday 580 840 320 
Saturday |560 420 160|)=A 
Sunday 860 1020 540 


A second matrix gives the selling prices per gallon and the 
profits per gallon for the three grades of gasoline sold by the 
convenience store. 


Selling Price Profit 

(per gallon) (per gallon) 
87 3.05 0.05 
89 3.15 0.08 | = B 
93 3:25 0.10 


54. 


55. 


Chapter 2. Review Exercises 117 


(a) Find AB. What is the meaning of AB in the context of the 
situation? 

(b) Find the convenience store’s total gasoline sales profit 
for Friday through Sunday. 


At a certain dairy mart, the numbers of gallons of skim, 2%, and 
whole milk that are sold on Friday, Saturday, and Sunday of a 
particular week are shown by the matrix. 

Skim 2% Whole 
Friday 40 64 52 
Saturday | 60 82 
Sunday 76 96 84 


A second matrix gives the selling prices per gallon and the prof- 
its per gallon for the three types of milk sold by the dairy mart. 


Selling Price Profit 
(per gallon) (per gallon) 
Skim | 3.32 1.32 
2% 3.22 1.07|}=B 
Whole | 3.12 0.92 


(a) Find AB. What is the meaning of AB in the context of the 
situation? 
(b) Find the dairy mart’s total profit for Friday through 
Sunday. 
The numbers of calories burned by individuals of different body 
weights performing different types of aerobic exercises for a 
20-minute time period are shown in the matrix. 


120-lb Person  150-lb Person 
Bicycling | 109 136 
Jogging 127 159;=A 
Walking 64 79 


A 120-pound person and a 150-pound person bicycled for 
40 minutes, jogged for 10 minutes, and walked for 60 minutes. 


(a) Organize the amounts of time spent exercising in a 
matrix B. 
(b) Find the product BA. 


(c) Explain the meaning of the matrix product BA as it 
applies to this situation. 
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56. The final grades in a particular linear algebra course at a 
liberal arts college are determined by grades on two midterms 
and a final exam. The grades for six students and two possible 
grading systems are shown in the matrices below. 


Midterm Midterm Final 
1 2 Exam 
Student 1 78 82 80] 
Student 2 84 88 85 
Student 3 92 93 90 


Student 4 88 86 90 et 
Student 5 74 78 80 
Student 6 96 95 98 

Grading Grading 

System I System 2 
Midterm 1 0.25 0.20 
Midterm 2 0.25 0.20| = B 
Final Exam | 0.50 0.60 


(a) Describe each grading system in matrix B and how it is 
to be applied. 


(b) Compute the numerical grades for the six students using 
the two grading systems. 


(c) Assign each student a letter grade for each grading 
system using the letter grade scale shown in the table 
below. 


Numerical Grade Range Letter Grade 


90-100 A 
80-89 B 
70-79 C 
60-69 D 
0-59 F 


Note: If necessary, round up to the nearest integer. 
Stochastic Matrices 


In Exercises 57 and 58, determine whether the matrix is stochastic. 


1 0 0 0.3 0.4 0.1 
57.|}0 05 0.1 58. |0.2 0.4 0.5 
0 0.1 0.5 05 02 0.4 


In Exercises 59 and 60, use the given matrix of transition 
probabilities P and state matrix X to find the state matrices PX, P2X, 
and P>X. 


1 1 

> 4 12 
9.0], | x=| i 

7 Ss 64 


0.6 0.2 0.0 1000 
60. P={0.2 0.7 O11}, X =| 1000 
0.2 0.1 0.9 1000 


oF) 61. A country is divided into 3 regions. Each year, 10% of the 


residents of Region 1 move to Region 2 and 5% move to Region 
3; 15% of the residents of Region 2 move to Region 1 and 5% 
move to Region 3; and 10% of the residents of Region 3 move 
to Region | and 10% move to Region 2. This year each region 
has a population of 100,000. Find the population of each region 
(a) in 1 year and (b) in 3 years. 


4p) 62. Find the steady state matrix for the populations described in 


Exercise 61. 


Cryptography 


In Exercises 63 and 64, find the uncoded row matrices of the 
indicated size for the given message. Then encode the message 
using the matrix A. 


63. Message: ONE IF BY LAND 
Row Matrix Size: 1 x 2 


BS) 2 
Encoding Matrix: A = > 1 


64. Message: BEAM ME UP SCOTTY 


Row Matrix Size: 1 x 3 


2 1 4 
Encoding Matrix: A = 3 1 3 
=), =7. =3 


In Exercises 65-68, find A~! to decode the cryptogram. Then 
decode the message. 


65. A =| 3 | 
if 4 
45 3436 —24 —4937 —23 2 
1 4 
A= 
66 Ee m| 
1152 —8 —9 —13 —39520 1256520 —2 7941 25 100 


37 29 57 —38 —39 31 


2 =i =] 
67. A=|-5 2 2\, 
+ =] =2 
58 —3 —25 —48 28 19 —40 13 13 —98 39 39 118 —25 —48 
28 —14 —-14 
1 2 3 
68.A=/2 5 3), 
1 0 8 
23 20 132 54 128 102 32 21 203 6 10 23 21 15 129 36 46 173 
29 72 45 


J In Exercises 69 and 70, use a graphing utility or computer software 
program with matrix capabilities to find A~', then decode the 
cryptogram. 


1 =2 2 
69. | —1 1 3 
1 -1 -4 
—225 39 —53 —72 —6 —9 93 4 —12 27 31 —49 —16 19 
—24 —46 —8 —799 
2 0 1 
70.|}2 —-1 0 
1 2 -4 


66 27 —31 375 —9 61 46 —73 46 
66 31 —53 47 33 —67 


1499421 —49 32 —4 12 


Leontief Input-Output Models 


71. An industrial system has two industries with the input require- 
ments shown below. 


(a) To produce $1.00 worth of output, Industry A requires 
$0.20 of its own product and $0.30 of Industry B’s 
product. 

(b) To produce $1.00 worth of output, Industry B requires 
$0.10 of its own product and $0.50 of Industry A’s 
product. 


Find D, the input-output matrix for this system. Then solve for 
the output matrix X in the equation X = DX + E, where the 
external demand is 


7 be 
80,000} 
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&e) 72. An industrial system with three industries has the input-output 


(pM matrix D and the external demand matrix E shown below. 
0.1 0.3 0.2 3000 
D=|0.0 0.2 0.3} and E = | 3500 
0.4 0.1 O.1 8500 


Solve for the output matrix X in the equation X = DX + E. 


Least Squares Regression Analysis 


45) In Exercises 73-76, find the least squares regression line for the 
points. 


73. (1,5), (2, 4), (3, 2) 

74. (2, 1), (3, 3), (4, 2), (5, 4), (6, 4) 

75. (—2, 4), (-1, 2), (0, 1), (1, —2), (2, —3) 
76. (1, 1), (1, 3), (1, 2), (1, 4), (2, 5) 


77. A farmer used four test plots to determine the relationship 
between wheat yield (in kilograms) per square kilometer and 
the amount of fertilizer (in hundreds of kilograms) per square 
kilometer. The results are shown in the table. 


Fertilizer, x 1.0 1.5 2.0 2D 


Yield, y 32 Al 48 53 


(a) Find the least squares regression line for these data. 
(b) Estimate the yield for a fertilizer application of 160 
kilograms per square kilometer. 
The Consumer Price Index (CPI) for all items for the years 2001 
to 2005 is shown in the table. (Source: Bureau of Labor 
Statistics) 


78. 


Year 2001 2002 2003 2004 2005 


CPI, y 177.1 179.9 184.0 188.9 195.3 


(a) Find the least squares regression line for these data. Let 
x represent the year, with x = 0 corresponding to 2000. 
(b) Estimate the CPI for the years 2010 and 2015. 


The table shows the average monthly cable television rates y in 
the United States (in dollars) for the years 2000 through 2005. 
(Source: Broadband Cable Databook) 


79. 


Year 2000 2001 2002 2003 2004 2005 


Rate, y | 30.37 32.87 34.71 36.59 38.14 39.63 
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(a) Use the method of least squares to find the least squares 

regression line for the data. Let x represent the year, 

with x = 0 corresponding to 2000. 

(b) Use the linear regression capabilities of a graphing 

utility to find a linear model for the data. How does this 

model compare with the model obtained in part (a)? 

(c) Use the linear model to create a table of estimated 

values for y. Compare the estimated values with the 
actual data. 

(d) Use the linear model to predict the average monthly 

rate in 2010. 

(e) Use the linear model to predict when the average 
monthly rate will be $51.00. 


P) 80. The table shows the numbers of cellular phone subscribers y (in 
millions) in the United States for the years 2000 through 2005. 
(Source: Cellular Telecommunications and Internet Association) 


Year 2000 2001 2002 2003 2004 2005 
Sub- 
scribers,y | 109.5 128.3 140.8 158.7 182.1 207.9 


(a) Use the method of least squares to find the least squares 
regression line for the data. Let x represent the year, 
with x = 0 corresponding to 2000. 

(b) Use the linear regression capabilities of a graphing 
utility to find a linear model for the data. How does this 
model compare with the model obtained in part (a)? 


(c) Use the linear model to create a table of estimated 
values for y. Compare the estimated values with the 
actual data. 

(d) Use the linear model to predict the number of sub- 
scribers in 2010. 

(e) Use the linear model to predict when the number of 
subscribers will be 260 million. 


81. The table shows the average salaries y (in millions of dollars) of 
Major League baseball players in the United States for the years 
2000 through 2005. (Source: Major League Baseball) 


Year 2000 2001 2002 2003 2004 2005 
Salary, y 1.8 2.1 23 2.4 2.3 25 


(a) Use the method of least squares to find the least squares 
regression line for the data. Let x represent the year, 
with x = 0 corresponding to 2000. 

(b) Use the linear regression capabilities of a graphing 
utility or computer software program to find a linear 
model for the data. How does this model compare with 
the model obtained in part (a)? 

(c) Use the linear model to create a table of estimated 
values for y. Compare the estimated values with the 
actual data. 

(d) Use the linear model to predict the average salary in 
2010. 

(e) Use the linear model to predict when the average salary 
will be 3.7 million. 


GN aidiwas Projects 


“| 1 Exploring Matrix Multiplication 


The first two test scores for Anna, Bruce, Chris, and David are shown in the table. 
Use the table to create a matrix M to represent the data. Input matrix M into a 
graphing utility or computer software program and use it to answer the following 


questions. 


Test1 Test 2 


Anna 84 96 
Bruce 56 2 
Chris 78 83 


David 82 91 
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. Which test was more difficult? Which was easier? Explain. 
. How would you rank the performances of the four students? 


NR 


1 0 
3. Describe the meanings of the matrix products uo | and ul | 


4. Describe the meanings of the matrix products[1 0 0 O|M and 
(0 0 1 OM. 


1 1 
5. Describe the meanings of the matrix products u| | and 5M al 


6. Describe the meanings of the matrix products[1 1 1 1]M and 
‘11 1 1 1). 
1 
7. Describe the meaning of the matrix product[1 1 1 11M) ‘| 


8. Use matrix multiplication to express the combined overall average score 
on both tests. 

9. How could you use matrix multiplication to scale the scores on test 1 by 
a factor of 1.1? 


3} 2 Nilpotent Matrices 


Let A be a nonzero square n X n matrix. Is it possible that a positive integer k exists 
such that A‘ = 0? For example, find A? for the matrix 


0 1 2 
A 0 0 il |}, 
0 0 0 


A square matrix A is said to be nilpotent of index k if A #0, A* #0,..., 
A‘! # 0, but A‘ = 0. In this project you will explore the world of nilpotent matrices. 
1. What is the index of the nilpotent matrix A? 
2. Use a graphing utility or computer software program to determine which 
of the matrices below are nilpotent and to find their indices. 


Oo 4 Des 0 0 

E 4 (®) [; ‘| (©) iF A| 
ne 0 0 1 0 0 0 
(d) | © \o on 0 ey li a 
io 0 RN aes 


. Find 3 x 3 nilpotent matrices of indices 2 and 3. 

. Find 4 x 4 nilpotent matrices of indices 2, 3, and 4. 

. Find a nilpotent matrix of index 5. 

. Are nilpotent matrices invertible? Prove your answer. 

. If A is nilpotent, what can you say about A’? Prove your answer. 
. If A is nilpotent, show that J — A is invertible. 


ONAN FW 


3.1 


3.2 


3.3 


3.4 


3.5 


122 


The Determinant of 
a Matrix 
Evaluation of a 
Determinant Using 
Elementary Operations 
Properties of 
Determinants 
Introduction to 
Eigenvalues 
Applications of 
Determinants 


Determinants 


CHAPTER OBJECTIVES 


Find the determinants of a 2 x 2 matrix and a triangular matrix. 


Find the minors and cofactors of a matrix and use expansion by cofactors to find the 
determinant of a matrix. 


Use elementary row or column operations to evaluate the determinant of a matrix. 
Recognize conditions that yield zero determinants. 
Find the determinant of an elementary matrix. 


Use the determinant and properties of the determinant to decide whether a matrix is singular 
or nonsingular, and recognize equivalent conditions for a nonsingular matrix. 


Verify and find an eigenvalue and an eigenvector of a matrix. 
Find and use the adjoint of a matrix to find its inverse. 
Use Cramer's Rule to solve a system of linear equations. 


Use determinants to find the area of a triangle defined by three distinct points, to find an 
equation of a line passing through two distinct points, to find the volume of a tetrahedron 
defined by four distinct points, and to find an equation of a plane passing through three 
distinct points. 


3.1 | The Determinant of a Matrix 


Every square matrix can be associated with a real number called its determinant. 
Determinants have many uses, several of which will be explored in this chapter. The first 
two sections of this chapter concentrate on procedures for evaluating the determinant of a 
matrix. 


Historically, the use of determinants arose from the recognition of special patterns that 


occur in the solutions of systems of linear equations. For instance, the general solution of 
the system 


AyjX1 F AyXy = dB, 


y)X1 + AyX, = by 


can be shown to be 


Definition of the 
Determinant of a 
2 x 2 Matrix 


EXAMPLE 1 
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= Dido, — bri bay, — bya, 


and x, = ; 
1499 ~ Ay) 419 A149 ~ 491419 


provided that a,,a,, — d,,a,, # 0. Note that both fractions have the same denominator, 
Ay, — A>,A,. This quantity is called the determinant of the coefficient matrix A. 


The determinant of the matrix 
Aa EB =| 
44, Ag 
is given by 


det(A) = |A| = @yy45) — ay 44. 


REMARK: In this text, det(A) and |A| are used interchangeably to represent the determi- 
nant of a matrix. Vertical bars are also used to denote the absolute value of a real number; 
the context will show which use is intended. Furthermore, it is common practice to delete 
the matrix brackets and write 
ie “| 
45, Ag 


A convenient method for remembering the formula for the determinant of a 2 x 2 matrix 
is shown in the diagram below. 


i oe = = y 
= 11479 ~ Ay1412 
31 2 


The determinant is the difference of the products of the two diagonals of the matrix. Note 
that the order is important, as demonstrated above. 


a a : 
a instead of 


45, Ag9 


[A] = 


The Determinant of a Matrix of Order 2 


SOLUTION 


Find the determinant of each matrix. 


a. =4 2 1 © 3 
@ =|" | w) B=) | @ c=) A 


(a) la] = | 73) = 20) 1(-3) =4+3=7 
2. @ 

) |BI= |, 4, = 22) - 4) =4-4=0 

@|cl=|) 4) =04) - 23) =0-6=-6 
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Definitions of Minors and 
Cofactors of a Matrix 


REMARK: The determinant of a matrix can be positive, zero, or negative. 
The determinant of a matrix of order | is defined simply as the entry of the matrix. For 
instance, if A = [—2], then 
det(A) = —2. 


To define the determinant of a matrix of order higher than 2, it is convenient to use the 
notions of minors and cofactors. 


If A is a square matrix, then the minor M;; of the element a; is the determinant of the 
matrix obtained by deleting the ith row and jth column of A. The cofactor C;; is given by 


Cy = (-1) IM, 


For example, if A is a 3 x 3 matrix, then the minors and cofactors of a, and a5, are as 
shown in the diagram below. 


Minor of a, Minor of ay, 
ay, dip a3 
_ 1412 443 a a a, 443 
ea | 4 tv | 2 | , 
32 33 r 31 33 
43, Ap a3 


Delete row 2 and column 1. Delete row 2 and column 2. 


Cofactor of a5, Cofactor of ay, 
Cy = (1? My 
= —M), 


As you can see, the minors and cofactors of a matrix can differ only in sign. To obtain the 
cofactors of a matrix, first find the minors and then apply the checkerboard pattern of +’s 
and —’s shown below. 


Sign Pattern for Cofactors 


+ = + = + 

+ _ + _ — + = + _ 

7 - + - + t+ - + - + 

ann oe = oe 

Ss seek — = = = ae 

3 x 3 matrix : : ‘i ; : 
4 x 4 matrix 


n X n matrix 


Note that odd positions (where i + j is odd) have negative signs, and even positions (where 
i + j is even) have positive signs. 


EXAMPLE 2 
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Find the Minors and Cofactors of a Matrix 


SOLUTION 


Definition of the 
Determinant of a Matrix 


Find all the minors and cofactors of 


0 2 1 
A=1/3 -1 2 |. 
4 0 1 


To find the minor M,,, delete the first row and first column of A and evaluate the determi- 
nant of the resulting matrix. 


0° 
aoe -1 2 
= 2|, M,, = = —1(1) — 022) = -1 
0 1 
0 1 
Similarly, to find M,,, delete the first row and second column. 
a2: 3 2 
3 “| Zils Ma=[h ‘| = 30 4(2) = —5 
4 1 


Continuing this pattern, you obtain 
M,,=—-1 M,, = —5 M,,= 4 
Mi, = 2 M,, = —4 M,, = —8 


My, = 5 M,, = —-3 M,, = —6. 


Now, to find the cofactors, combine the checkerboard pattern of signs with these minors to 
obtain 


Cy, = —-1 Co = 5 Cz= 4 
Cy, = —2 Cy = —4 Cy = 
C3,= 5 Cy = 3 C3, = —6. 


Now that the minors and cofactors of a matrix have been defined, you are ready for a 
general definition of the determinant of a matrix. The next definition is called inductive 
because it uses determinants of matrices of order n — 1 to define the determinant of a 
matrix of order n. 


If A is a square matrix (of order 2 or greater), then the determinant of A is the sum of the 
entries in the first row of A multiplied by their cofactors. That is, 


det(A) = |A| = SayjCy = ayCy + ayCy +--+ + 4,,Ci,. 
j=l 


REMARK: Try checking that, for 2 x 2 matrices, this definition yields |A| = a,,a,. — 
5141, as previously defined. 
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When you use this definition to evaluate a determinant, you are expanding by cofactors 
in the first row. This procedure is demonstrated in Example 3. 


EXAMPLE 3 The Determinant of a Matrix of Order 3 


Find the determinant of 


0 2 1 
A=|3 -1l 2). 
4 0 1 


SOLUTION This matrix is the same as the one in Example 2. There you found the cofactors of the entries 
in the first row to be 


C,=-1, Ci. = 5, Ci = 4. 
By the definition of a determinant, you have 


|A| = aC, al AoC yo + 443C\3 First row expansion 
= 0(-1) + 2(5) + 1(4) = 14. 


Although the determinant is defined as an expansion by the cofactors in the first row, it 
can be shown that the determinant can be evaluated by expanding by any row or column. 
For instance, you could expand the 3 x 3 matrix in Example 3 by the second row to obtain 


|Al = iy Capt asOy Fay a, Second row expansion 
3(—2) + (—1)(—4) + 2(8) = 14 


ll 


or by the first column to obtain 


A] = a,,C,, + a,Co, + a,,C First column expansion 
| 111 2121 31 31 
= 0(-1) + 3(-2) + 4(5) = 14. 


Try other possibilities to confirm that the determinant of A can be evaluated by expanding 
by any row or column. This is stated in the theorem below, Laplace’s Expansion of a 
Determinant, named after the French mathematician Pierre Simon de Laplace (1749-1827). 


THEOREM 3.1 
Expansion by Cofactors 


EXAMPLE 4 
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When expanding by cofactors, you do not need to evaluate the cofactors of zero entries, 
because a zero entry times its cofactor is zero. 


aC = (0), =0 
The row (or column) containing the most zeros is usually the best choice for expansion by 


cofactors. This is demonstrated in the next example. 


The Determinant of a Matrix of Order 4 


SOLUTION 


Technology 
Note 


Most graphing utilities and 
computer software programs have 
the capability of calculating the 
determinant of a square matrix. 

If you use the determinant 
command of a graphing utility to 
verify that the determinant of the 
matrix A in Example 4 Is 39, your 
screen may look like the one below. 
Keystrokes and programming syntax 


for these utilities/programs applica- 
ble to Example 4 are provided in 
the Online Technology Guide, 
available at college hmco.com/pic/ 
larsonELA6e. 


Find the determinant of 


{ -=2 3 0 
=1 1 2 
A= : : 
0 2 0 3 
3 4 0 —2 


By inspecting this matrix, you can see that three of the entries in the third column are zeros. 
You can eliminate some of the work in the expansion by using the third column. 


|A] = 3(C,3) + O(C,3) + O(C33) + (C43) 


Because C,,, C33, and C,, have zero coefficients, you need only find the cofactor C,;. To 
do this, delete the first row and third column of A and evaluate the determinant of the 
resulting matrix. 


=1 1 2 -1 1 2 
C,,=(-1)'*3} 0 2 3)=|] 0 2 3 
3 4 -2 3 4 -2 
Expanding by cofactors in the second row yields 
1 2 =] 2 =] 1 
C,, = (0)(-1)?*! + (2)(—1)?*? + (3)(-1)?*3 
= owe Teaco) Jl+ercne| > || 


= 0 + 2(1)(—4) + 3(—1)(-7) = 13. 
You obtain |A| = 3(13) = 39. 


There is an alternative method commonly used for evaluating the determinant of a3 x 3 
matrix A. To apply this method, copy the first and second columns of A to form fourth and 
fifth columns. The determinant of A is then obtained by adding (or subtracting) the 
products of the six diagonals, as shown in the following diagram. 


Subtract these three products. 


Add these three products. 


128 =Chapter 3 Determinants 


EXAMPLE 5 


Try confirming that the determinant of A is 


|A| = G1 97033 + AyoQy33, + Gy 3M)A39 — 31497413 — A39Gy34) — A33My 1p. 


The Determinant of a Matrix of Order 3 


lay 


Simulation 

To explore this concept further with 
an electronic simulation, and for 
keystrokes and programming syntax 
regarding specific graphing utilities 
and computer software programs 
involving Example 5, please visit 
college.hmco.com/picNarsonELA6e. 
Similar exercises and projects are 
also available on this website. 


SOLUTION 


REMARK: The diagonal 
process illustrated in Example 5 
is valid only for matrices of 
order 3. For matrices of higher 
orders, another method must 

be used. 


Find the determinant of 


O@ 2 1 
A=|3 -1. 2\|. 
4-4 1 


Begin by recopying the first two columns and then computing the six diagonal products as 
follows. 


~<@— Subtract these products. 


0 16 =12 <= = Add these products. 


Now, by adding the lower three products and subtracting the upper three products, you can 
find the determinant of A to be |A| = 0 + 16 + (—12) — (—4) -0-6 =2. 


Triangular Matrices 


Evaluating determinants of matrices of order 4 or higher can be tedious. There is, however, 
an important exception: the determinant of a triangular matrix. Recall from Section 2.4 that 
a square matrix is called upper triangular if it has all zero entries below its main diagonal, 
and lower triangular if it has all zero entries above its main diagonal. A matrix that is both 
upper and lower triangular is called diagonal. That is, a diagonal matrix is one in which all 
entries above and below the main diagonal are zero. 


Upper Triangular Matrix Lower Triangular Matrix 


4, 42 43 °° 7° Ay a, O Oe 0) 
0 a) G3; +--+ Ay, G4) Gy, O «+--+ O 
| EZ 93, a2 %; Ge 
0 0 0 pias ann any an2 an3 == Ann 


To find the determinant of a triangular matrix, simply form the product of the entries on 
the main diagonal. It is easy to see that this procedure is valid for triangular matrices of 
order 2 or 3. For instance, the determinant of 


THEOREM 3.2 
Determinant of a 
Triangular Matrix 


PROOF 


EXAMPLE 6 
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2 a: 1 
A=|0 -l 2 
0 0 3 
can be found by expanding by the third row to obtain 
| | 2 3 
A| = 0(-1)3*! + O(- 1)3*? + 3(—1)3*3 
| ) =] , oa 0 , CD 0 _ 
= 3(1)(—2) = -6, 


which is the product of the entries on the main diagonal. 


If A is a triangular matrix of order n, then its determinant is the product of the entries on 
the main diagonal. That is, 


nn* 


det(A) = |A| = a,,4543,: - +a 


You can use mathematical induction* to prove this theorem for the case in which A is an 
upper triangular matrix. The case in which A is lower triangular can be proven similarly. If 
A has order 1, then A = [a,,] and the determinant is |A| = a,,. Assuming the theorem is true 
for any upper triangular matrix of order k — 1, consider an upper triangular matrix A of order 
k. Expanding by the kth row, you obtain 


|A| = 0C,, + OC +--+ + OC yu — 1) F ayy = Ag Cig 


Now, note that C,, = (—1)*M, = M,, where M,, is the determinant of the upper trian- 
gular matrix formed by deleting the kth row and kth column of A. Because this matrix is 
of order k — 1, you can apply the induction assumption to write 


|A| = ay Mix = Aly ,4y70133 * : “Aki 4-1) = Gy 14y9433° * * Ag 


The Determinant of a Triangular Matrix 


Find the determinant of each matrix. 


(b) B= 


A 
| 
i) 

we OO 

wn oo eo 
oo oor 
coco OW CO 
oon oo oO 
of oOo oO 
Noo CO Oo 


*A discussion of mathematical induction can be found in Appendix A. 
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SOLUTION 


(a) The determinant of this lower triangular matrix is given by 


[A] = (2)(—2)()(3) = —12. 
(b) The determinant of this diagonal matrix is given by 


|B] = (— 1)(3)(2)(4)(—2) = 48. 


ante meme Exercises 


In Exercises 1—12, find the determinant of the matrix. 


1. [1] 2. [-3] 


In Exercises 13-16, find (a) the minors and (b) the cofactors of the 
matrix. 


1 2 =a 0 
wf) 7] nf 
3 4 2 1 

=3 2 1 =3 4 2 
15. 4 ) 6 16. 6 3 1 
2 =3 1 4 -7 —-8 


17. Find the determinant of the matrix in Exercise 15 using the 
method of expansion by cofactors. Use (a) the second row and 
(b) the second column. 

18. Find the determinant of the matrix in Exercise 16 using the 
method of expansion by cofactors. Use (a) the third row and (b) 
the first column. 


In Exercises 19-34, use expansion by cofactors to find the determi- 
nant of the matrix. 


1 4 -2 2 —-1 3 
19 3 2 0 20. | 1 4 4 
=I 4 3 1 0 2 
2 6 =o 0 0 
21. f 3 1 22. | 7? il 0 
0 Ov -=5 1 2 2 
0.1 0.2 0.3 —-04 04 0.3 
23. os 0.2 0.2 24. | 0.2 0.2 0.2 
05 04 04 0.3 0.2 0.2 
x y 1 x y 
25. F 3 1 26. -2 =2 1 
O° = 1 1 5 1 
2 6 6 2 1 + 3 2 
27. 7 3 6 28. F 6 2 1 
1 5 0 1 0 0 0 0 
3 7 0 i 3. 2 1 2) 
> 3 0 6 3 0 7 0 
29. 6 4 12 30. 6 11 12 
0 2. ==3 4 4 1 -1 2 
0 t =2 2 1 5 2 10 
w x y Zz w x y z 
21-15 24 30 10 15 -—25 30 
ah E 24 —32 18 am E 20-15 -=10 
—40 22 32 —35 30 35 —25 —40 


§ 2 0. 0 =—2 4 3 -2 1 2 
0 1 4 = 3 2 0 O 0 0 O 
33.}0 0 2 6 3 34.) 1 2: =F 13> 12 
0 0 3 4 1 6 —2 5 6 F 
0 0 0 0O 2 1 4 2 0 9 
In Exercises 35-40, use a graphing utility or computer software 


program with matrix capabilities to find the determinant of the 
matrix. 


> 1 -5 0.25 -1 06 
35.14 -; —-4 36.|050 08 -02 
3 2-2 0.75 0.9 -04 
4 4 2. 3 1 2 4 -1 
1 6-1 2 6 2 3 -2 
7) 3 2 4 5 Pla at a 
6 1 3 -2 5 -2 2 4 
1 2-1 4 2-1 
0 1 2-2-3 1 
0 3 2-1 3 -2 
ol ae re oe a 
1-2 3 1 2-1 
2 0 2 3 1 1 
8 5 1-2 0 3 
-1 0 7 #1 6 -5 
0 8 6 5 -3 1 
O) 1 2 5 -8 4 3 
2 6-2 0 6 7 
8 -3 1 2-5 1 


In Exercises 41—46, find the determinant of the triangular matrix. 


—2 0 0 5 0 0 
41.| 4 6 O 4.10 6 0 
-3 7 2 0 0 -3 
5 8 -4 2 4 0 0 0 
_ 1 
wo 9 6 °O a.{72 2 9 0 
0 0 2 2 3 5 3 0 
0 0 O -1 -8 7 0 -2 
-1 4 2 1 -3 
0 3 -4 5 2 
4.|; 0 0 2 7 +O 
0 0 0 5 -1 
co Oo. o 4 
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7 0 0 0 0 
-8§ + 0 0 0 
46. 4 5 2 0) 0 
3-3 3. =i 0 
t 13 4 1 =2 


True or False? In Exercises 47 and 48, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, 
provide an example that shows the statement is not true in all cases 
or cite an appropriate statement from the text. 


47. (a) The determinant of the 2 x 2 matrix A is a4), — 1,4. 
(b) The determinant of a matrix of order 1 is the entry of the 
matrix. 
(c) The ij-cofactor of a square matrix A is the matrix defined by 
deleting the ith row and the jth column of A. 


48. (a) To find the determinant of a triangular matrix, add the 
entries on the main diagonal. 


(b) The determinant of a matrix can be evaluated using 
expansion by cofactors in any row or column. 


(c) When expanding by cofactors, you need not evaluate the 
cofactors of zero entries. 


In Exercises 49-54, solve for x. 


x+3 2 y= 2 1 

49, 1 pee iad 50. 3 “ =0 
xt+1 =2 x +3 1 

51. 1 pg) 52. =f =o 
x— 1 2 y= 2 —1 

53. 3 ee 54, 3 Be 


In Exercises 55—58, find the values of A for which the determinant 
is zero. 


A+2 2 AI 1 
spt? 2] gol 
A 0 A 0 1 
57.|0 A+1 2 58. |0 A 3 
0 1 4A 2 2 A= 2 
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In Exercises 59-64, evaluate the determinant, in which the entries 
are functions. Determinants of this type occur when changes of 


variables are made in calculus. 


4u ach | 3x = By" 
59. | _ 1 diy 60. 1 1 
ek ex e* xe* 
of 2e* 3e%* ee —e@* (1 — x)e* 
x In x x xInx 
; 1 1/x es 1 1+Inx 


65. The determinant of a 2 x 2 matrix involves two products. The 
determinant of a3 x 3 matrix involves six triple products. Show 
that the determinant of a 4 x 4 matrix involves 24 quadruple 
products. (In general, the determinant of an nm x n matrix 
involves n! n-fold products.) 


66. Show that the system of linear equations 
ax + by=e 
cx+dy=f 


has a unique solution if and only if the determinant of the 


69. 


71. 


72. 


73. 


74. 


w xX} _ijwoox + cw 70 w x 
y z y zt+ey “lew ex 
1 x? 
1 y |= Go-we- we 7) 
1 z 2 
at+b a a 
a atb a| = b°(3a + b) 
a at+b 
1 1 1 
a b c|= (a — b)\(b — c)(e — a) 
2 P 2 
1 1 1 
a b c| = (a — b\(b — cle — alla 
eo pb 3 
75. You are given the equation 
x 0 c 
=1 x b |= ax? + bx +c. 
0 -I a 


c) 


coefficient matrix is nonzero. . : 
(a) Verify the equation. 


In Exercises 67-74, evaluate the determinants to verify the (b) Use the equation as a model to find a determinant that 


i is equal to ax? + bx? + cx + d. 

i ; y - ie ee oy ie 76. Writing Explain why it is easy to calculate the determinant of 
67. |e 68. =c a matrix that has an entire row of zeros. 

y wx y cz y z 


Evaluation of a Determinant Using Elementary 
Operations 


Which of the two determinants shown below is easier to evaluate? 


1 
4 
—2 
3 


[A] = 


—2 
=6 

4 
=6 


3 
3 
=9) 
9 


1 
2 
=3 
2 


or 


L. 2 
0 2 
0 0 
0 0 


|B] = 


3 
=9 
= 

0 


1 
=2 
= 
=] 


EXAMPLE 1 


Section 3.2 Evaluation of a Determinant Using Elementary Operations 133 


Given what you now know about the determinant of a triangular matrix, it is clear that the 
second determinant is much easier to evaluate. Its determinant is simply the product of the 
entries on the main diagonal. That is, |B] = (1)(2)(—3)(— 1) = 6. On the other hand, using 
expansion by cofactors (the only technique discussed so far) to evaluate the first determi- 
nant is messy. For instance, if you expand by cofactors across the first row, you have 


-6 3 2 4 3 2 4 -6 2 4 -6 3 
(AL ed) a SB a a SB) BH SB d= 2 A, 
-6 9 2 3 9 2 3 -6 2 3-6 9 


Evaluating the determinants of these four 3 x 3 matrices produces 
|A| = (1)(— 60) + (2)(39) + (3)(— 10) — (1)(— 18) = 6. 


It is not coincidental that these two determinants have the same value. In fact, you can 
obtain the matrix B by performing elementary row operations on matrix A. (Try verifying 
this.) In this section, you will see the effects of elementary row (and column) operations on 
the value of a determinant. 


The Effects of Elementary Row Operations on a Determinant 


(a) The matrix B was obtained from A by interchanging the rows of A. 


2, =3 1 4 

|A| = =11 and |B| = =-11 
1 4 2 = 3 

(b) The matrix B was obtained from A by adding —2 times the first row of A to the second 
row of A. 

I. =3 Il =3 

|A| = |=2 and 3 =| |=2 
2 -4 0 2 


(c) The matrix B was obtained from A by multiplying the first row of A by i 
2 -8 1 -4 
=2 9 p) 9 


|A| = |=2 and ial = |_ =1 


In Example 1, you can see that interchanging two rows of a matrix changed the sign of 
its determinant. Adding a multiple of one row to another did not change the determinant. 
Finally, multiplying a row by a nonzero constant multiplied the determinant by that same 
constant. The next theorem generalizes these observations. The proof of Property 1 follows 
the theorem, and the proofs of the other two properties are left as exercises. (See Exercises 
54 and 55.) 
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THEOREM 3.3 
Elementary Row Operations 
and Determinants 


PROOF 


HISTORICAL NOTE 


Augustin-Louis Cauchy 
(1789-1857) 

was encouraged by Pierre Simon 
de Laplace, one of France’s lead- 
ing mathematicians, to study 
mathematics. Cauchy is often 
credited with bringing rigor 
to modern mathematics. To 
read about his work, visit 
college.hmco.com/pic/larsonELA6e. 


EXAMPLE 2 


Let A and B be square matrices. 

1. If B is obtained from A by interchanging two rows of A, then 
det(B) = —det(A). 

2. If B is obtained from A by adding a multiple of a row of A to another row of A, then 
det(B) = det(A). 

3. If B is obtained from A by multiplying a row of A by a nonzero constant c, then 


det(B) = c det(A). 


To prove Property 1, use mathematical induction, as follows. Assume that A and B are 
2 x 2 matrices such that 


A= ie | | B= Fe | 
4, Ag Gy Nh 
Then, you have |A| = a,,45) — d5,4)7 and |B| = ay,4,, — 44,4). So |B| = —|A|. Now 
assume the property is true for matrices of order (n — 1). Let A be an n x n matrix such 
that B is obtained from A by interchanging two rows of A. Then, to find |A| and |B], expand 
along a row other than the two interchanged rows. By the induction assumption, the 
cofactors of B will be the negatives of the cofactors of A because the corresponding 


(n — 1) x (n — 1) matrices have two rows interchanged. Finally, |B] = —|A| and the 
proof is complete. 


REMARK: Note that the third property of Theorem 3.3 enables you to divide a row by the 
common factor. For instance, 
I 
1 


Factor 2 out of first row. 


Theorem 3.3 provides a practical way to evaluate determinants. (This method works 
particularly well with computers.) To find the determinant of a matrix A, use elementary 
row operations to obtain a triangular matrix B that is row-equivalent to A. For each step in 
the elimination process, use Theorem 3.3 to determine the effect of the elementary row 
operation on the determinant. Finally, find the determinant of B by multiplying the entries 
on its main diagonal. This process is demonstrated in the next example. 


Evaluating a Determinant Using Elementary Row Operations 


Find the determinant of 
2 -3 10 
A=]1 2 =2'\. 
0) 1 =3 
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SOLUTION Using elementary row operations, rewrite A in triangular form as follows. 


2 =3 10 i 2 =2 
Interchange the first two rows. 
1 2 =2)==—|2 =—3 10 
0 1 -3 0 1 -3 
1 2 = 2 
Add —2 times the first row to the second 
=) 14 < row to produce a new second row. 
0 1 -3 
1 =2 
= 7/0 1 -2 <= Factor —7 out of the second row. 
0) 1 =3 
1 2. =2 
= 7/0 1 —2 Add —1 times the second row to the third 
0 0 -1 <@— row to produce a new third row. 


Now, because the final matrix is triangular, you can conclude that the determinant is 


|A| = 7(1)(1)(— 1) = —7. 


Determinants and Elementary Column Operations 


Although Theorem 3.3 is stated in terms of elementary row operations, the theorem 
remains valid if the word “column” replaces the word “row.” Operations performed on the 
columns (rather than the rows) of a matrix are called elementary column operations, and 
two matrices are called column-equivalent if one can be obtained from the other by 
elementary column operations. The column version of Theorem 3.3 is illustrated as follows. 


2 lL =3 1 2, =3 2 3. =5 1 a. = 
4 0 1) = —]0 4 1 + 1 0) = 2) 2 1 0 
0 0 2 0 0 2 =2 4 -3 =] 4 -3 


Interchange the first two columns. Factor 2 out of the first column. 


In evaluating a determinant by hand, it is occasionally convenient to use elementary column 
operations, as shown in Example 3. 
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EXAMPLE 3 


Evaluating a Determinant Using Elementary Column Operations 


SOLUTION 


THEOREM 3.4 


Conditions That Yield 
a Zero Determinant 


PROOF 


Find the determinant of 


=1 2 2 
A=| 3 -6 4]. 
5-10 =3 


Because the first two columns of A are multiples of each other, you can obtain a column of 
zeros by adding 2 times the first column to the second column, as follows. 


=1 2 2A |-1 0 2 
3 -6 4=| 3 oO 4 
5-10 -3 5 0 -3 


At this point you do not need to continue to rewrite the matrix in triangular form. Because 
there is an entire column of zeros, simply conclude that the determinant is zero. The valid- 
ity of this conclusion follows from Theorem 3.1. Specifically, by expanding by cofactors 
along the second column, you have 


|A| _ (0)C,> + (orem oF (O)Gys = 0. 


Example 3 shows that if one column of a matrix is a scalar multiple of another column, 
you can immediately conclude that the determinant of the matrix is zero. This is one of 
three conditions, listed next, that yield a determinant of zero. 


Each part of this theorem is easily verified by using elementary row operations and expan- 
sion by cofactors. For example, if an entire row or column is zero, then each cofactor in the 
expansion is multiplied by zero. If condition 2 or 3 is true, you can use elementary row or 
column operations to create an entire row or column of zeros. 


EXAMPLE 4 
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Recognizing the conditions listed in Theorem 3.4 can make evaluating a determinant 
much easier. For instance, 


0 0 0 iS 4 1 2 ia 
2 4 —-5| =0, 0 1 2| = 0, 2 -1 —6|=0. 
3 -=5 2 ih 7) 4 = 0 6 


The first row 
has all zeros. 


The first and third 
rows are the same. 


The third column is a 
multiple of the first column. 


Do not conclude, however, that Theorem 3.4 gives the only conditions that produce a 
determinant of zero. This theorem is often used indirectly. That is, you can begin with a 
matrix that does not satisfy any of the conditions of Theorem 3.4 and, through elementary 
row or column operations, obtain a matrix that does satisfy one of the conditions. Then 
you can conclude that the original matrix has a determinant of zero. This process is demon- 
strated in Example 4. 


A Matrix with a Zero Determinant 


SOLUTION 


Find the determinant of 


1 4 1 
A=|2 -1l 0}. 
0 18 4 


Adding —2 times the first row to the second row produces 
1 4 1 1 4 1 
|A| = |2 -1 Oo} =|0 -9 -2). 
0 18 4 O 18 4 


Now, because the second and third rows are multiples of each other, you can conclude that 
the determinant is zero. 


In Example 4 you could have obtained a matrix with a row of all zeros by performing 
an additional elementary row operation (adding 2 times the second row to the third row). 
This is true in general. That is, a square matrix has a determinant of zero if and only if it is 
row- (or column-) equivalent to a matrix that has at least one row (or column) consisting 
entirely of zeros. This will be proved in the next section. 

You have now surveyed two general methods for evaluating determinants. Of these, the 
method of using elementary row operations to reduce the matrix to triangular form is 
usually faster than cofactor expansion along a row or column. If the matrix is large, then 
the number of arithmetic operations needed for cofactor expansion can become extremely 
large. For this reason, most computer and calculator algorithms use the method involving 
elementary row operations. Table 3.1 (on page 138) shows the numbers of additions (plus 
subtractions) and multiplications (plus divisions) needed for each of these two methods for 
matrices of orders 3, 5, and 10. 


138 = Chapter 3 Determinants 


TABLE 3.1 
Cofactor Expansion Row Reduction 
Order n Additions Multiplications Additions — Multiplications 
3 5 9 5 10 
5 30 45 
10 3,628,799 6,235,300 285 339 


In fact, the number of operations for the cofactor expansion of an n x n matrix grows 


like n!. Because 30! ~ 2.65 x 10%, even a relatively small 30 x 30 matrix would require 
more than 10°? operations. If a computer could do one trillion operations per second, it 
would still take more than one trillion years to compute the determinant of this matrix using 
cofactor expansion. Yet, row reduction would take only a few seconds. 

When evaluating a determinant by hand, you can sometimes save steps by using elemen- 
tary row (or column) operations to create a row (or column) having zeros in all but one 
position and then using cofactor expansion to reduce the order of the matrix by 1. This 
approach is illustrated in the next two examples. 


Find the determinant of 


-3 5 
A=| 2 -4 
-3 0 


EXAMPLE 5|_ Evaluating a Determinant 


2 
= 1). 
6 


SOLUTION Notice that the matrix A already has one zero in the third row. You can create another zero in 
the third row by adding 2 times the first column to the third column, as follows. 


-3 5 2 |-3 5 -4 
lAJ=| 2 -4 -1}=| 2 -4 3 
-3 0 6 |-3 0 0 


Expanding by cofactors along the third row produces 


iz 


[4] 


II 

| 
a 

| 
<x 


II 

| 
Ww 
— 
—_ 
wa 
— 

I 
_ 
a 


—4 


EXAMPLE 6 
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Evaluating a Determinant 


SOLUTION 


Evaluate the determinant of 


2 0 1 3 =2 

=2 1 3 2 =] 

A= 1 0 -1 2 3 
3. = 2 4 -3 

1 1 3 2 0 


Because the second column of this matrix already has two zeros, choose it for cofactor 
expansion. Two additional zeros can be created in the second column by adding the second 
row to the fourth row, and then adding — | times the second row to the fifth row. 


2 0 1 3 -2 
—2 1 3 2-1 
l=} 1 OO -1 2 3 
3-1 2 4 -3 
i gt 3s 2 @ 
, 0 1 3 -2 
2 Ts 32} 
=|] 1 -1 2 3 
1 5 6 -4 
3 o © aA 
2 1 3 -2 
1-1 2 3 
= (1)(-1)4 
((-) 1 5 6 -4 
0 oOo 1 


(You have now reduced the problem of finding the determinant of a 5 x 5 matrix to find- 
ing the determinant of a 4 x 4 matrix.) Because you already have two zeros in the fourth 
row, it is chosen for the next cofactor expansion. Add —3 times the fourth column to the 
first column to produce the following. 


2 1 3 -2 8 1 3 - 
wpe fi “2 2 3Lf-8 -1 2 
1 5 6 -4 |13 5 6 -4 
a: 7 @ fF 0 e—if 
8 1 3 
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Add the second row to the first row and then expand by cofactors along the first row. 


8 1 3| |-e—e—~5f 


JA}=|-8 -1 2;/=|-8 -1 
13 5 6 13 5 
= 5-148 ~ | = sc 27) = —135 
13 5 
AGT eye Exercises 
In Exercises 1-20, which property of determinants is illustrated by 6 0 0 0 1 0 0 0 
the equation? 1 
vf © 9 F_,0 0 0 
2 -6 ug 3 0 0 6 O 0 Oo 1 0 
Ly ~§| = 0 el 0 0 0 6 0 0 0 1 
i 4&4 4% —4 59 3 13. |2 | _ i =4 
3/0 O O|=0 4.| 8 0 O|=0 8 7 10 «19 
5 6-7 -4 3 2 14, [2 ‘=f 1 
3 4 1 4 3 O =] 4 1 
5. |=7 2 =-5|=—-|-—7 =5 2 1 -3 p) 1 -3 2: 
6 1 2 6 2 1 5.| 5 2 -1l;/=| 0 17-11 
3 4 cf @& 2 -1 oO 6 |-1 O 6 
6. |-2 2 Oo] = -—|-2 2 0 3 9) 4 3 2 -6 
6 2 a 16. |-2 1 S|=|-2 1 O 
1 1 2 5 -7 -20 5 -7 15 
Tl le al 
oI” ee 5 4 2 5 4 2 
ie i =? i 17.|4 -3 4/=-|-4 3 -4 
"|2 8 1 8 7 6 3 7 6 3 
1 8 -3 1 2-1 > t. =i 2 1-1 
9/3 -12 6|=1213 -3 2 1%. /0 1 4=-|5 3 1 
4 9 7 1 3 5 & 4 0 1 4 
i 2 3 t at 4 2S tet ee 
10.|4 -8 6=64 -4 2 ; : : : ; 
5 «#@ 2 s 2. a : [ = 
Pel a oe S a or? 
5 0 10 i @ 2 -| & S&S 3 #4 =3 
11. | 25 -30 40)/=53] 5 -6 8 —-2 0 2 6 4 -4 
-15 5 20 -3 1 4 
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4 3 1 9 6 9 
9 -l1 2 3 0 -3 
3 4 6 9 -6 12 
au: 5 2 0 6 12 6 = 
6 0 3 0 -3 0 
1-2 1-3 9 -6 


In Exercises 21-24, use either elementary row or column opera- 
tions, or cofactor expansion, to evaluate the determinant by hand. 
Then use a graphing utility or computer software program to verify 
the value of the determinant. 


Evaluation of a Determinant Using Elementary Operations 


1 0 2 =1 3 2 
21. |-1 1 4 22. | O 2 0 
2 0 3 1 {. =1 
1 2 1 =] 3 2 1 1 
0 1 0 2 =1 
23. 24. : 7 : 
0 32 1 1 i. =i 0 
0 0 4 1 3 1 1 0 


In Exercises 25—38, use elementary row or column operations to 
evaluate the determinant. 


1 t =3 1 1 1 
25. |1 3 1 26. |2 —-1 —2 
4 8 1 1 -=2 =1 
2 =1 =1 3 =i =3 
27. |1 3 2 28. |-1 -4 -2 
1 1 3 3- =i = 
4 3 2 3 So =] 
29. | 5 4 1 30. |0 —5 4 
=2 3 4 6 1 6 
2 =8 0 4 -8 5 
31. | 9 7 4 32. |8 —5 3 
—8 d 1 8 5 2 
4 -7 9 1 9 -4 2 > 
6 2 7 0 2 7 = 
33. 34. 5 i 
3 6 —3 3 4 tT =2 0 
0 7 4 -1 7 3 4 10 
1 -2 7 9 0. .=3 8 2 
3. -4 | 3 8 ! =1 6 
5. 6. 
3 6 1. =1 2 —4 6 0 9 
4 =) 3 2 =] 0 Oo 14 
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f--t 8 4 2 
2 6 0 -4 3 
37.2 0 2 2 
0 2 8 0 
oO 1 1 2 

3-2 3 1 

- 0 1 0 

38.| 5 -1 3 2 

4 57 - 0 Oo 

1 2 3 0 2 


True or False? In Exercises 39 and 40, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, 
provide an example that shows the statement is not true in all cases 
or cite an appropriate statement from the text. 


39. (a) Interchanging two rows of a given matrix changes the sign 
of its determinant. 


(b) Multiplying a row of a matrix by a nonzero constant 
results in the determinant being multiplied by the same 
nonzero constant. 


(c) If two rows of a square matrix are equal, then its determinant 
is 0. 
40. (a) Adding a multiple of one row of a matrix to another row 
changes only the sign of the determinant. 


(b) Two matrices are column-equivalent if one matrix can be 
obtained by performing elementary column operations on 
the other. 


(c) If one row of a square matrix is a multiple of another row, 


then the determinant is 0. 


In Exercises 41—46, find the determinant of the elementary matrix. 
(Assume k # 0.) 


1 O O 1 0 0O 0 1 0 
41.)0 k 0O 42.);0 1 O 43./1 0 0 
0 oO 1 0 O k 0 oO 1 
0 oO 1 1 0 0 1 0O 0O 
44.;0 1 0O 45.;k 1 O 46.;0 1 0 
1 0 0O 0 oO 1 Oo k 1 
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47. 


48. 
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Prove the property. 


41, G2 43 Dy, Ay a; (a;, + dy) ay a4; 
Ay, Ay Ay3| + ]bo) Go G3] = |(ay, + bo1) ayy Ay; 
43; 3. 433 bs, xy 33 (45, + b3) sy 433 


Prove the property. 


l+a 1 1 11 
1 1+b5 1 = abe 13 + t ) 
bc 
1 1 l+ec 
a#0, b#0, c#0 


In Exercises 49-52, evaluate the determinant. 


49. 


51. 


53. 


54. 


cos @ sin@ 50 sec @ tan @ 
—sin@ cos @ * |tan @ sec 0 
sin 0 1 sec 0 1 
1 sin 4 a 1 sec i 


Writing Solve the equation for x, if possible. Explain your 
result. 


cos x 0 sin x 
sin x 0) —cos x =0 
sin x — cos x 1 sin x + cos x 


Guided Proof Prove Property 2 of Theorem 3.3: If B is 
obtained from A by adding a multiple of a row of A to 
another row of A, then det(B) = det(A). 


Getting Started: To prove that the determinant of B is equal 
to the determinant of A, you need to show that their respective 
cofactor expansions are equal. 


3.3 


55. 


56. 


(i) Begin your proof by letting B be the matrix obtained by 

adding c times the jth row of A to the ith row of A. 

(ii) Find the determinant of B by expanding along this ith 
row. 

(iii) Distribute and then group the terms containing a coef- 
ficient of c and those not containing a coefficient of c. 

(iv) Show that the sum of the terms not containing a coef- 
ficient of c is the determinant of A and the sum of the 
terms containing a coefficient of c is equal to 0. 


Guided Proof Prove Property 3 of Theorem 3.3: If B is 
obtained from A by multiplying a row of A by a nonzero 
constant c, then det(B) = c det(A). 


Getting Started: To prove that the determinant of B is equal 
to c times the determinant of A, you need to show that the 
determinant of B is equal to c times the cofactor expansion of the 
determinant of A. 


(i) Begin your proof by letting B be the matrix obtained by 
multiplying c times the ith row of A. 
(ii) Find the determinant of B by expanding along this ith 
row. 
(iii) Factor out the common factor c. 
(iv) Show that the result is c times the determinant of A. 


Writing A computer operator charges $0.001 (one tenth of a 
cent) for each addition and subtraction, and $0.003 for each 
multiplication and division. Compare and contrast the costs of 
calculating the determinant of a 10 x 10 matrix by cofactor 
expansion and then by row reduction. Which method would you 
prefer to use for calculating determinants? 


Properties of Determinants 


In this section you will learn several important properties of determinants. You will begin 
by considering the determinant of the product of two matrices. 


EXAMPLE 1 


The Determinant of a Matrix Product 


Find |A], 
1 -2 
A=|0 3 
1 0 


B|, and |AB| for the matrices 


SOLUTION 


THEOREM 3.5 
Determinant of a 
Matrix Product 


PROOF 
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Using the techniques described in the preceding sections, you can show that |A| and |B| have 
the values 


1-2 2 2 0 1 
AJ=|0 3 2)/=-7 and |Bl)=|0 -1 2) =11. 
l © 4 3 1 -2 


The matrix product AB is 
1 =2 2||2 
AB =1|0 3 21/10 1 2|=|6 1. = 10); 
1 0 1} {3 I =2 5 1 =1 


Using the same techniques, you can show that |AB| has the value 


8 4 1 
|AB] = |6 —1 —10| = -77. 
5 1-1 


In Example 1, note that the determinant of the matrix product is equal to the product of 
the determinants. That is, 
|AB| = |A|B| 
—77 = (-7)(11). 


This is true in general, as indicated in the next theorem. 


If A and B are square matrices of order n, then 
det(AB) = det(A) det(B). 


To begin, observe that if E is an elementary matrix, then, by Theorem 3.3, the next few state- 
ments are true. If E is obtained from / by interchanging two rows, then |E| = —1. If 
E is obtained by multiplying a row of J by a nonzero constant c, then |E| = c. If E is 
obtained by adding a multiple of one row of / to another row of J, then |E| = 1. Additionally, 
by Theorem 2.12, if E results from performing an elementary row operation on J and the 
same elementary row operation is performed on B, then the matrix EB results. It follows that 


|EB = |E| |BI. 
This can be generalized to conclude that |E,- - - E,E,B| = |E,|- - -|E5| |E,| |B], where 
E, is an elementary matrix. Now consider the matrix AB. If A is nonsingular, then, by 
Theorem 2.14, it can be written as the product of elementary matrices A = E,- - - E,E, 


and you can write 
|AB| = |E,- + - E,E,BI 
= |El -  |E| IE IB] = [E> » 22] |B] = [A] |B. 
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THEOREM 3.6 
Determinant of a 
Scalar Multiple of a Matrix 


PROOF 


EXAMPLE 2 


If A is singular, then A is row-equivalent to a matrix with an entire row of zeros. From 
Theorem 3.4, you can conclude that |A| = 0. Moreover, because A is singular, it follows 
that AB is also singular. (If AB were nonsingular, then A[B(AB)~!] = J would imply that A 
is nonsingular.) So, |AB| = 0, and you can conclude that |AB| = |A||B]. 


REMARK: Theorem 3.5 can be extended to include the product of any finite number of 
matrices. That is, 


|A,A,A3 - . “A, = |A,||A,||As| ans - |A;|- 


The relationship between |A| and |cA| is shown in the next theorem. 


If A is ann X n matrix and c is a scalar, then the determinant of cA is given by 


det(cA) = c” det(A). 


This formula can be proven by repeated applications of Property 3 of Theorem 3.3. Factor 
the scalar c out of each of the n rows of |cA| to obtain 


\cA] = cA]. 


The Determinant of a Scalar Multiple of a Matrix 


SOLUTION 


Find the determinant of the matrix. 


10 —20 40 
A= 30 0 50 
—20 —-30 10 
Because 
1 -2 4 1 =2 4 
A=10) 3 0 5 and 3 0) 5} =5, 
=) -=3 1 =2 =3 1 


you can apply Theorem 3.6 to conclude that 
E =2 4 
|A| = 107} 3 0 5] = 1000(5) = 5000. 
=2. =3 1 


THEOREM 3.7 
Determinant of an 
Invertible Matrix 


PROOF 


Discovery 


6 
0 
1 


1 


Use a graphing utility or 
computer software program to 
find A~'. Compare det(A~') 
with det(A). Make a conjecture 
about the determinant of the 
inverse of a matrix. 
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Theorems 3.5 and 3.6 provide formulas for evaluating the determinants of the product of 
two matrices and a scalar multiple of a matrix. These theorems do not, however, list a 
formula for the determinant of the sum of two matrices. It is important to note that the sum 
of the determinants of two matrices usually does not equal the determinant of their sum. 
That is, in general, |A| + |B| # |A + B]. For instance, if 


9 9 


then |A| = 2 and |B| = -3, but +B =|) 0 


| ang ants ie, 


Determinants and the Inverse of a Matrix 


You saw in Chapter 2 that some square matrices are not invertible. It can also be difficult 
to tell simply by inspection whether or not a matrix has an inverse. Can you tell which of 
the two matrices shown below is invertible? 


0 2, =] 0 2. =] 
A=|3 -2 1 or B=/3 -2 1 
3 2 =1 3 2 1 


The next theorem shows that determinants are useful for classifying square matrices as 
invertible or noninvertible. 


A square matrix A is invertible (nonsingular) if and only if 


det(A) # 0. 
To prove the theorem in one direction, assume A is invertible. Then AA~! = J, and by 
Theorem 3.5 you can write |A||A~'| = |J|. Now, because |/| = 1, you know that neither 


determinant on the left is zero. Specifically, |A] # 0. 

To prove the theorem in the other direction, assume the determinant of A is nonzero. 
Then, using Gauss-Jordan elimination, find a matrix B, in reduced row-echelon form, that 
is row-equivalent to A. Because B is in reduced row-echelon form, it must be the identity 
matrix J or it must have at least one row that consists entirely of zeros. But if B has a row 
of all zeros, then by Theorem 3.4 you know that |B] = 0, which would imply that |A| = 0. 
Because you assumed that |A| is nonzero, you can conclude that B = J. A is, therefore, 
row-equivalent to the identity matrix, and by Theorem 2.15 you know that A is invertible. 
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EXAMPLE 3 


Classifying Square Matrices as Singular or Nonsingular 


SOLUTION 


THEOREM 3.8 
Determinant of an 
Inverse Matrix 


PROOF 


Which of the matrices has an inverse? 


0 2 =] 0 a2 =1 
(a) |3. =2 1 (b) |}3 -2 1 
3 2 =] 3 2 1 


(a) Because 


0 2. =] 

3-2 1) = 0, 

3 2 = 1 

you can conclude that this matrix has no inverse (it is singular). 
(b) Because 

0 2. =) 

3. =2 1) = -12 #0, 

3 2 1 


you can conclude that this matrix has an inverse (it is nonsingular). 


The next theorem provides a convenient way to find the determinant of the inverse of a 
matrix. 


If A is invertible, then 
1 
det(A) 


det(A~!) = 


Because A is invertible, AA~' = J, and you can apply Theorem 3.5 to conclude that 
|A||A~'| = |Z| = 1. Because A is invertible, you also know that |A| # 0, and you can divide 
each side by |A| to obtain 


1 
|A“'| = 


ll’ 


EXAMPLE 4 
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The Determinant of the Inverse of a Matrix 


SOLUTION 


Equivalent 
Conditions for a 
Nonsingular Matrix 


Find |A~!| for the matrix 


1 0 3 
A=|0 -l 2 |. 
2 1 0 


One way to solve this problem is to find A~! and then evaluate its determinant. It is easier, 
however, to apply Theorem 3.8, as follows. Find the determinant of A, 


1 0 3 
|A|J=|0 -1 2) =4, 
2 1 0 
and then use the formula |A~!| = 1/|A| to conclude that |A~!| = 4. 


REMARK: In Example 4, the inverse of A is 


f= 


Nie eS NI 
Ble IW BIW 
Ble NI BIW 


Try evaluating the determinant of this matrix directly. Then compare your answer with that 
obtained in Example 4. 

Note that Theorem 3.7 (a matrix is invertible if and only if its determinant is nonzero) 
provides another equivalent condition that can be added to the list in Theorem 2.15. All six 
conditions are summarized below. 


REMARK: In Section 3.2 you saw that a square matrix A can have a determinant of zero 
if A is row-equivalent to a matrix that has at least one row consisting entirely of zeros. The 
validity of this statement follows from the equivalence of Properties 4 and 6. 
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EXAMPLE 5 


Systems of Linear Equations 


SOLUTION 


THEOREM 3.9 
Determinant of a 
Transpose 


EXAMPLE 6 


Which of the systems has a unique solution? 

(a) 2X, — XxX, = —1 (b) 2X, — XxX, =—1 
Bh = 2h. Pe 4 3x, —2x,+%,= 4 
3x, + 2x, —x, = —4 3x, + 2x, +x, = —4 


From Example 3 you know that the coefficient matrices for these two systems have the 
determinants below. 


6 2 =i 0 2 =i 
(a) |3 -2 1|/=0 (b) |3 —-2 1)/=-12 
q 2 <i a 2 4 


Using the preceding list of equivalent conditions, you can conclude that only the second 
system has a unique solution. 


Determinants and the Transpose of a Matrix 


The next theorem tells you that the determinant of the transpose of a square matrix is 
equal to the determinant of the original matrix. This theorem can be proven using math- 
ematical induction and Theorem 3.1, which states that a determinant can be evaluated 
using cofactor expansion along a row or a column. The details of the proof are left to you. 
(See Exercise 56.) 


If A is a square matrix, then 


det(A) = det(A’). 


The Determinant of a Transpose 


SOLUTION 


Show that |A| = |A”| for the matrix below. 


3 1 -2 
A=| 2 0 0 
-4 -1 5 


To find the determinant of A, expand by cofactors along the second row to obtain 
1 =2 
—1 P) 


|A| = 2(-1)3 


| = (2)(—1)() = -6. 


To find the determinant of 


a 2 
AT= 1 0 
=—2 0 


—4 
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—1|, 


5 


expand by cofactors down the second column to obtain 


[a"| = 2(=1 


—2 


=] 


A| = |A’|. 


5 = QX-D@ = 6. So, 


JAN eee Exercises 


In Exercises 1-6, find (a) |A], (b) |B], (c) AB, and (d) |AB|. Then 
verify that |A||B| = |AB]. 


—2 1 1 1 
1. 4-| | 2-| | 
4 -2 0 -1 
1 2 =j. 2 
24=| i B-| 
2 4 3 0 
-1 2 1 -1 0 0 
3.A=]| 1 O JI; B=] 0 2 
0 1 O 0 0 3 
2 0 1 2: =1 
4A=|]1 -1 2) B=|0 1. 3 
3 1 0 3-2 1 
2 oO 1 1 1 o-1 1 
1-1! oO 1 2 1 0 2 
me hy 3 1 of Phi 1-1 O 
1 2 3 0 3 2 1 0 
3 4 0 4 2-1 O 
1-1 2 1 1 1 2-1 
a 0 O 3 ipF®=| 0 0 2 1 
-1 1 1 #0 -1 0 0 0 


In Exercises 7-10, use the fact that |cA| = c”|A| to evaluate the 
determinant of the n x n matrix. 


nA=(6 | 8.4=| 7 | 
6 —-8 10 —20 
=3 6 9 4 16 
9 A= 6 9 12 10.A=|12 -8 8 
9 12 15 16 20 —4 


oy) 


In Exercises 11-14, find (a) |A], (b) |B 
verify that |A] + |B] # |A + Bl. 


, and (c) |A + B]. Then 


uw a=|—) i B=| : 7 
2 0 = 2 0 
2.A=() | a-(? | 
1 0 0 0 
1 0 1 a | 0 2 
13. A=|-1 2 1], B= 0 1 2 
1 1 1 1 1 
0 1 2 0 1 -l 
14.4 =]1 —-1 0], B= {2 1 1 
2 1 1 0 1 1 
In Exercises 15-18, find (a) |A7], (b) |A?|, (c) |AA7|, (d) |2A], and 
(e) |A-}]. 
a-(! al 16.4=|~% " 
4 -5 5 6 
2 0 5 1 5 4 
17,.A=|]4 -1 6 18. A =|0 —-6 2 
3 2 1 0 0 —3 


In Exercises 19-22, use a graphing utility or computer software 


program with matrix capabilities to find (a) |A|, (b) |A7|, (©) |A?|, 
(d) |2A], and (e) |A~!]. 
4 2 =2; 4 
19. A= 20. A = 
& ‘| | 6 sl 


(M21, 


IM 22. A = 
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NY WwW 


NS 
Ne RW 
w 
Nn 


23. Let A and B be square matrices of order 4 such that |A] = —5 
and |B| = 3. Find (a) |AB|, (b) |A3|, (c) 3B], (d) |(AB)"|, and 
(e) |Aq}]. 
Let A and B be square matrices of order 3 such that |A| = 10 
and |B] = 12. Find (a) |AB|, (b) |A4], (c) |2B], (@) |(AB)"|, and 
(e) |A-!]. 


24. 


25. Let A and B be square matrices of order 4 such that |A| = 4 and 
|B| = 2. Find (a) |BA], (b) |B?], (c) |2A], (d) |(AB)7], and (e) 
|B". 

26. Let A and B be square matrices of order 3 such that |A| = —2 
and |B| = 5. Find (a) |BA], (b) |B+|, (c) |2A], (d) |(AB)7|, and 
(e) |B". 


In Exercises 27-34, use a determinant to decide whether the matrix 
is singular or nonsingular. 


27. | : | 28. i 7 
10 8 4 3 
4. 5 | 1 0 4 
29./-2 0 3 30.]0 6 3 
1 -5 ~-10 2-1 4 
| a 2 te. % 
31.|% -3 0 32.| 1 -; 4 
5 3 
1 1 1 =3 3 8 
i © =) 2 0.8 0.2 -06 0.1 
0 8 -1 10 -12 06 06 O 
33. 34. 
0 0 0 1 0.7 -03 O01 O 
0 0 0 2 0.2 -03 06 O 


In Exercises 35-40, find |A~!|. Begin by finding A~!, and then 
evaluate its determinant. Verify your result by finding |A| and 
ath 
Al 


then applying the formula from Theorem 3.8, |A~!| = 


3.a=|' 1 36.4 =|) i 
1 4 2 23 


1 0 2 1 0 1 
37. A=|]2 —-1 3 38. A=]2 —-1 2 
1; =2 2 1-2 3 
1 0 -1 3 
1 =_ 
39. A = . : 7 
2 0 2. = 1. 
I 23 1 2 
0 1 0 3 
1 =2 =3 1 
40. A = 0 0 > 2 
1 -2 -4 1 


In Exercises 41—44, use the determinant of the coefficient matrix 
to determine whether the system of linear equations has a unique 
solution. 


41. x,- x, + x, =4 42. x, + x,- x, =4 
2X, — X,+ x3, =6 2x, X + x, = 6 
3x, — 2x, + 2x, = 0 3x, — 2x, + 2x, = 0 
os) 43 2x, X, + 5x,+ x= 5 
(tM x, + x, — 3x, - 4x, = —1 
2x, + 2x, + 2x, — 3x, 2 
x, + Sx, — 6x, = 3 
oe 44 Hi Hy Hk = 0 
IM X, +x, — x, -— x4 =0 
x, $x, +x, - x, = 0 
Xy + xy + x3 +x, = 6 


In Exercises 45—48, find the value(s) of k such that A is singular. 


k-1 3 k-1 2 
45. 4=| : | 46.4 =| ; a 

1 0 3 1 k 2: 
47,.A=|]2 —-1 0 48. A=|-2 0 —k 

4 2 k 3 1 =4 
49. Let A and B be n x n matrices such that AB = J. Prove that 


|A| # O and |B] 4 0. 
. Let A and B be n x n matrices such that AB is singular. Prove 
that either A or B is singular. 


51. Find two 2 x 2 matrices such that |A] + |B] = |A + Bl. 
52. Verify the equation. 
at+b a a 
a at+b a| = b°(3a + b) 
a a at+b 


53. Let A be ann x n matrix in which the entries of each row add 
up to zero. Find |A|. 
54. Illustrate the result of Exercise 53 with the matrix 


2 =1 =1 
A= |-3 1 2 |. 
Qs =2 2 


55. Guided Proof Prove that the determinant of an invertible 
matrix A is equal to +1 if all of the entries of A and A~! are 
integers. 

Getting Started: Denote det(A) as x and det(A~!) as y. Note 
that x and y are real numbers. To prove that det(A) is equal to 
+1, you must show that both x and y are integers such that their 
product xy is equal to 1. 


(i) Use the property for the determinant of a matrix 
product to show that xy = 1. 

(ii) Use the definition of a determinant and the fact that the 
entries of A and A~! are integers to show that both 
x = det(A) and y = det(A~!) are integers. 

(iii) Conclude that x = det(A) must be either 1 or —1 
because these are the only integer solutions to the 
equation xy = 1. 


56. Guided Proof Prove Theorem 3.9: If A is a square matrix, then 
det(A) = det(A”). 

Getting Started: To prove that the determinants of A and A? 
are equal, you need to show that their cofactor expansions are 
equal. Because the cofactors are + determinants of smaller 
matrices, you need to use mathematical induction. 


(i) Initial step for induction: If A is of order 1, then A = 
[a,,] = A, so det(A) = det(A7) = a),. 

(ii) Assume the inductive hypothesis holds for all matrices 
of order n — 1. Let A be a square matrix of order n. 
Write an expression for the determinant of A by 
expanding by the first row. 

(iii) Write an expression for the determinant of A’ by 
expanding by the first column. 

(iv) Compare the expansions in (i) and (ii). The entries of 
the first row of A are the same as the entries of the first 
column of A’. Compare cofactors (these are the + 
determinants of smaller matrices that are transposes of 
one another) and use the inductive hypothesis to 
conclude that they are equal as well. 

57. Writing Let A and P be nxn matrices, where P is 
invertible. Does P~'AP = A? Illustrate your conclusion with 
appropriate examples. What can you say about the two 
determinants |P~'AP| and |A|? 
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58. Writing Let A be an nxn nonzero matrix satisfying 
A!° = O. Explain why A must be singular. What properties of 
determinants are you using in your argument? 


True or False? In Exercises 59 and 60, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, 
provide an example that shows that the statement is not true in all 
cases or cite an appropriate statement from the text. 


59. (a) If A is ann x n matrix and c is a nonzero scalar, then the 
determinant of the matrix cA is given by nc - det(A). 
(b) If A is an invertible matrix, then the determinant of A~! is 
equal to the reciprocal of the determinant of A. 
(c) If A is an invertible n x n matrix, then Ax = b has a 
unique solution for every b. 
60. (a) In general, the determinant of the sum of two matrices 
equals the sum of the determinants of the matrices. 
(b) If A is a square matrix, then the determinant of A is equal 
to the determinant of the transpose of A. 
(c) If the determinant of an n x n matrix A is nonzero, then 
Ax = 0 has only the trivial solution. 

61. A square matrix is called skew-symmetric if A7 = —A. Prove 
that if A is an n xn skew-symmetric matrix, then |A| = 
(-1)"Al. 

62. Let A be a skew-symmetric matrix of odd order. Use the result 
of Exercise 61 to prove that |A| = 0. 


In Exercises 63-68, determine whether the matrix is orthogonal. An 


invertible square matrix A is called orthogonal if A~! = A’. 
Pa [9 
1 0 1 0 
1 -l i/y2 1/572 
5. : 
: & | Ee = /2 
1 0 O 7/2 9 -1/V2 
67. | 0 0 1 68. 0 1 0 


0 if 0 1//2 0 1//2 


69. Prove that if A is an orthogonal matrix, then |A| = +1. 
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J In Exercises 70 and 71, use a graphing utility with matrix capabilities 73. Let S be an n x n singular matrix. Prove that for any n x n 
to determine whether A is orthogonal. To test for orthogonality, find matrix B, the matrix SB is also singular. 
(a) A~!, (b) A’, and (c) |Al, and verify that A~' = A” and |A| = +1. 74, Let A,,, A;>, and A,, ben x n matrices. Find the determinant of 
3 Fy 2 2 \ the partitioned matrix 
5 Oo = 307300 OB 
2 =/'|2 1 2 An Aj. 
70. A=|0 1 0 71. A =}3 7.3 0 A 
22 
4 0 3 1 2 2 
5 5 3 3 3 


in terms of the determinants of A,,, A,>, 


and A,,. 


72. If A is an idempotent matrix (A? = A), then prove that the 
determinant of A is either 0 or 1. 


3.4 | Introduction to Eigenvalues 


This chapter continues with a look ahead to one of the most important topics of linear 
algebra—eigenvalues. One application of eigenvalues involves the study of population 
growth. For example, suppose that half of a population of rabbits raised in a laboratory 
survive their first year. Of those, half survive their second year. Their maximum life span is 
3 years. Furthermore, during the first year the rabbits produce no offspring, whereas the 
average number of offspring is 6 during the second year and 8 during the third year. If there 
are 24 rabbits in each age class now, what will the distribution be in 1 year? In 20 years? 

As you will find in Chapter 7, the solution of this application depends on the concept of 
eigenvalues. You will see later that eigenvalues are used in a wide variety of real-life appli- 
cations of linear algebra. Aside from population growth, eigenvalues are used in solving 
systems of differential equations, in quadratic forms, and in engineering and science. 

The central question of the eigenvalue problem can be stated as follows. If A is ann x n 
matrix, do there exist n x 1 nonzero matrices x such that Ax is a scalar multiple of x? The 
scalar is usually denoted by A (the Greek letter lambda) and is called an eigenvalue of A, 
and the nonzero column matrix x is called an eigenvector of A corresponding to A. The 
fundamental equation for the eigenvalue problem is 


AX = Xx. 


EXAMPLE 1| _ Verifying Eigenvalues and Eigenvectors 


1 4 1 2 
Let A = , x, = : and x, = . 
2 3 1 =1 


Verify that A, = 5 is an eigenvalue of A corresponding to x, and that A, = — | is an eigen- 
value of A corresponding to x;. 


SOLUTION To verify that A, = 5 is an eigenvalue of A corresponding to x,, multiply the matrices A and 
x,, as follows. 


avely allie [sl=silsas 


EXAMPLE 2 
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Similarly, to verify that A, = —1 is an eigenvalue of A corresponding to x,, multiply A 
and x,. 


mE IGA 


From this example, you can see that it is easy to verify whether a scalar A and ann x | 
matrix x satisfy the equation Ax = Ax. Notice also that if x is an eigenvector corresponding 
to A, then so is any nonzero multiple of x. For instance, the column matrices 


Eb} me [oy 
and 
2 =], 
are also eigenvectors of A corresponding to A, = 5. 


Provided with an n x n matrix A, how can you find the eigenvalues and corresponding 
eigenvectors? The key is to write the equation Ax = Ax in the equivalent form 


(Al — A)x = 0, 


where / is the n x n identity matrix. This homogeneous system of equations has nonzero 
solutions if and only if the coefficient matrix (AJ — A) is singular; that is, if and only if 
the determinant of (AJ — A) is zero. The equation det(AJ — A) = 0 is called the character- 
istic equation of A, and is a polynomial equation of degree n in the variable A. Once you 
have found the eigenvalues of A, you can use Gaussian elimination to find the correspon- 
ding eigenvectors, as shown in the next two examples. 


Finding Eigenvalues and Eigenvectors 


SOLUTION 


4 
Find the eigenvalues and corresponding eigenvectors of the matrix A = i i 


The characteristic equation of A is 


wea IE 3 


_[a-1 = 
= oa 
='’-4+3-8 
=)\2-44-5 


= (A-5)(A+ 1) =0. 


This yields two eigenvalues, A, = 5 and A, = —1. 
To find the corresponding eigenvectors, solve the homogeneous linear system 
(AI — A)x = 0. For A, = 5, the coefficient matrix is 


ively sil aleP <2 s-sleL2 ah 
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Technology 
Note 


Most graphing utilities and 
computer software programs have 
the capability of calculating the 
eigenvalues of a square matrix. 
Using a graphing utility to verify 
Example 2, your screen may look 
like the one below. Keystrokes and 
programming syntax for these 
utilities/programs applicable to 


Example 2 are provided in the 
Online Technology Guide, 
available at college. hmco.com/ 
pic/larsonELA6e. 


EXAMPLE 3 


which row reduces to 


lo of 


The solutions of the homogeneous system having this coefficient matrix are all of the form 


where f is a real number. So, the eigenvectors corresponding to the eigenvalue A, = 5 are 
the nonzero scalar multiples of 


Similarly, for A, = — 1, the corresponding coefficient matrix is 


af AE Jl aa 


which row reduces to 
loo 
0 Onn 


The solutions of the homogeneous system having this coefficient matrix are all of the form 


—ft ’ 
where f is a real number. So, the eigenvectors corresponding to the eigenvalue A, = — 1 are 
the nonzero scalar multiples of 


|i} 


Finding Eigenvalues and Eigenvectors 


Find the eigenvalues and corresponding eigenvectors of the matrix 
1 2 =2 
A= 1 2 1}. 
= =i 0 
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SOLUTION The characteristic equation of A is 


A 0 O 1 2-2 A-1 —2 2 
jar—Al=|}o a of-| 1 2 a1ff=] -1 a-2 -1 
0 oO A =] =] 0 1 1 A 

A-2 -1 1 if 1A 2 

= 0-1) 1 lJ 1 f+ 1 


= (A — 1)? — 2A + 1) + 2(-A + 1) + 2(-1 — A + 2) 
=N- 3M -—A+4+3 =(H%—- 1)A- 3) =0. 
This yields three eigenvalues, A, = 1, A, = —1, and A; = 3. 


To find the corresponding eigenvectors, solve the homogeneous linear system 
(AI — A)x = 0. For A, = 1, the coefficient matrix is 


1 0 0 1 2. °=2 
I-A=)0 1 0} - 1 2 1 
0 0 1 -1 -Il 0 
1-1 =), 2 QO -2 2 
= 1 1-2 1|= 1 1 1], 
1 1 1 1 1 1 
which row reduces to 
1 0 2 
0 1 =|; 
0 oO O 


The solutions of the homogenous system having this coefficient matrix are all of the form 
—2t 
t > 
t 


where ¢ is a real number. So, the eigenvectors corresponding to the eigenvalue A, = | are 
the nonzero scalar multiples of 


=2 
1}. 
1 
For A, = —1, the coefficient matrix is 
a 0 0 1 2. =, 
-I-Az= Oo =] 0} - 1 2, 1 
0 0 -i1 =f 0 
-1-1 —2 2 =2'.-=2" 2 
= 1 1-2 1} = 1 3 1], 
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which row reduces to 


lL 0 =2 
Oo 1 1}. 
0 oO O 
The solutions of the homogeneous system having this coefficient matrix are all of the form 
2t 
—ft ; 
t 
where ¢ is a real number. So, the eigenvectors corresponding to the eigenvalue A, = — | are 
the nonzero scalar multiples of 
2 
='1 |; 
1 


For A, = 3, the coefficient matrix is 


3 0) 0) 1 2 -2 
31 -A=]0 3 0} -— 1 2 1 
0) 0) 3 -1 -l 0) 
3-1 =) 2, 2 =—2. 2 
= | 3=+2 1] = 1 1-1], 
1 i 3 1 1 3 
which row reduces to 
1 0 2 
0 1 Ls 
0 oO O 


The solutions of the homogeneous system having this coefficient matrix are all of the form 
=2t 
—f p 
t 
where f is a real number. So, the eigenvectors corresponding to the eigenvalue A, = 3 are 
the nonzero scalar multiples of 
=2 
=I. 
1 


Eigenvalues and eigenvectors have ample applications in mathematics, engineering, 
biology, and other sciences. You will see one such application to stochastic processes at the 
end of this chapter. In Chapter 7 you will study eigenvalues and their applications in more 
detail and learn how to solve the rabbit population problem presented earlier. 
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aeNe ieee Exercises 


Eigenvalues and Eigenvectors 


In Exercises 1—4, verify that A; is an eigenvalue of A and that x; is 
a corresponding eigenvector. 


tact 7h xet =|" 
0 =3)’ 1 ° 1 0’ 
3 _ =1 
-3 »=[7,] 


1 1 1 1 
3.A=/0 1 OJ; A, = 2, x, =] 0}; 
1 1 1 1 
—1 =I 
4, =0, x» =| Of A=1, v-| 1 
1 =1 
1, = 2 1 1 
4A=]0 1 4) A =1 x, =]0} 
0 oO 2 0 
—7 
A, =2, xX,=] 4 
1 


In Exercises 5-14, find (a) the characteristic equation, (b) the 
eigenvalues, and (c) the corresponding eigenvectors of the matrix. 


| 


2 4 x 4 
ale “al 8|5 3 
-2 4 3 = 1 
[> 4] [3 —)| 
1-1 -1 2 o 1 
ite| 1 2 4 12.)0 3 4 
-3 1-1 0 Oo 1 
i 2 @ 1 0 1 
3/0 @«@ 14.]0 -1 0 
4 0 1 2 1-1 


49) In Exercises 15-24, use a graphing utility or computer software 


program with matrix capabilities to find the eigenvalues of the 
matrix. Then find the corresponding eigenvectors. 


2 35 4 3 

[23 «(4 23] 

4 =2 =2 4 0 0 
17.;0 1 O 18.;0 0 —3 

1 0O 1 0-2 1 

1 0 -1 1 1 0 
19.|}0 —2 0 20.;0 -2 1 

0. 2 =2 0 —2 2 

3 0 0 0 1 0 2 3 

0 -1 0 0] im 0 2 0 0 

lle 

ah 0 0 2 >) oe 0 0 1 3 

0 0 3 0 0 -1 3 1 

1 0 1 0 2 0 -1 -1 

0. =2 0 0 0 2 1 0 
a: 0 0 2 1 me 0 -1 0 0 

0 0 3 0 0 0 2 0 


True or False? In Exercises 25 and 26, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, 
provide an example that shows the statement is not true in all cases 
or cite an appropriate statement from the text. 


25. (a) Ifx is an eigenvector corresponding to a given eigenvalue A, 
then any multiple of x is also an eigenvector corresponding 
to that same A. 
(b) If A = a is an eigenvalue of the matrix A, then A = a isa 
solution of the characteristic equation AJ — A = 0. 


26. (a) The characteristic equation of the matrix A = i a 


yields eigenvalues A, = A, = 1. 


4.2 Se : 
= a, has irrational eigenvalues 


A, =2+ JV6andaA, =2- V6. 


(b) The matrix A = 
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EXAMPLE 1 


3.5 | Applications of Determinants 


So far in this chapter, you have examined procedures for evaluating determinants, studied 
properties of determinants, and learned how determinants are used to find eigenvalues. In 
this section, you will study an explicit formula for the inverse of a nonsingular matrix and 
then use this formula to derive a theorem known as Cramer’s Rule. You will then solve 
several applications of determinants using Cramer’s Rule. 


The Adjoint of a Matrix 


Recall from Section 3.1 that the cofactor C;; of a matrix A is defined as (—1)‘*/ times the 
determinant of the matrix obtained by deleting the ith row and the jth column of A. If A is 
a square matrix, then the matrix of cofactors of A has the form 


Cy Cy ++: Cy, 
Cr Crp rr Coy 
oe ee <= Cr, 


The transpose of this matrix is called the adjoint of A and is denoted by adj(A). That is, 


Ch, Cy ut Cu 

(G (es nee C 
adj(A) =|? PA, 

Ge C. a on 


Finding the Adjoint of a Square Matrix 


SOLUTION 


Find the adjoint of 


=] 3 2 
A= 0 =2 1 
1 0 =2 


i323 
- —2 1 
—2 1) —— Cc, =(-1) i 
0 -2 
0 -2 


Continuing this process produces the following matrix of cofactors of A. 


THEOREM 3.10 
The Inverse of a Matrix 
Given by Its Adjoint 


PROOF 
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j-2 if jo 1 0 -2|| 
0 -2 1 -2 1 0 

: 2 Fe 2 a Mele a = 
0 -2 1 -2 1 of je 
3 2 |-1 2) |-1. 3 

-2 1 0 1 0 -2 


The transpose of this matrix is the adjoint of A. That is, 


4 6 7 
adj(A)=|1 O 1). 
. 2 & 


The adjoint of a matrix A can be used to find the inverse of A, as indicated in the 
next theorem. 


If A is ann X n invertible matrix, then 


el 
~~ det(A) 


call 


adj(A). 


Begin by proving that the product of A and its adjoint is equal to the product of the determi- 
nant of A and J, 
Consider the product 


4) 42 777% Ain 
4) Ang °° * Gan | 1Cy Cy +: Gu 
ee : Cy C C. Cc 
7 _ 12 22 G2, n2 
Alagiay}=| : : 
il i2 in ie a 
7 : Cin Con Ci, Cn 
Gynt Ang °° Ann 


The entry in the ith row and jth column of this product is 


aij + Ai2C jn +--+-+4.C, 


in~jn* 


If i = j, then this sum is simply the cofactor expansion of A along its ith row, which means 
that the sum is the determinant of A. On the other hand, if i # j, then the sum is zero. 


det(A) O --- O 


0 det(A)--- O 


Aladj(A)] = = det(A)I 


0 0 +++ det(A) 
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Because A is invertible, det(A) # 0 and you can write 
1 ; _ 1 : _ 
dea) “Ladi =! or Al cia aai(a)| = I, 


Multiplying both sides of the equation by A~! results in the equation 


_ ‘| det(A) 


1 
: =f ak oe 
2a) | A~'I, which yields aaa) adj(A) = Al. 


b 
IfA isa2 x 2 matrix A = b | then the adjoint of A is simply 
Cc 
d —b 
adj(A) = i 
—c a 
Moreover, if A is invertible, then from Theorem 3.10 you have 
1 1 d —b 
A l= adj(A) = | 
|A| ad — belL-c a 


which agrees with the result in Section 2.3. 


EXAMPLE 2| Using the Adjoint of a Matrix to Find Its Inverse 


Use the adjoint of 


=i 3 2 
A= 0 =2 1 
1 0 =2 


to find A7!. 


SOLUTION The determinant of this matrix is 3. Using the adjoint of A (found in Example 1), you can 
find the inverse of A to be 


4 7 
‘ 4 6 7 [3 2 3 

A} [ssi = 3 i 0 tele oO 4 
2 3 2 2) 2 


You can check to see that this matrix is the inverse of A by multiplying to obtain 


2 


7 
-1 3 3 3 1 0 0 
a -2 11; O Fl=]o 1. O}. 
1 0 -2}/2 4 2 [oO Oo 1 
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REMARK: Theorem 3.10 is not particularly efficient for calculating inverses. The Gauss- 
Jordan elimination method discussed in Section 2.3 is much better. Theorem 3.10 is theo- 
retically useful, however, because it provides a concise formula for the inverse of a matrix. 


Cramer’s Rule 


Cramer’s Rule, named after Gabriel Cramer (1704-1752), is a formula that uses determi- 
nants to solve a system of n linear equations in n variables. This rule can be applied only 
to systems of linear equations that have unique solutions. 

To see how Cramer’s Rule arises, look at the solution of a general system involving two 
linear equations in two variables. 


AyjX1 + AyyX = dD, 
Ay)X, + AyX, = dy 


Multiplying the first equation by —a,, and the second by a,, and adding the results produces 


yA, )Xy — Ay AynXy = —Ay,d, 
AyjAy1X, F AyjAyXy = Ayydy 
(4,149 ~ Ay {445)Xp = 4b) — ay,b). 


Solving for x, (provided that a,,a,, — a,a,, # 0) produces 


by — Ay)b, 


xX, = : 
411472 ~ 4y1412 


In a similar way, you can solve for x, to obtain 


AyD, — Ajab, 


411492 ~ 4g) 


Finally, recognizing that the numerators and denominators of both x, and x, can be 
represented as determinants, you have 


by ay ay Db 

by Ay _ Ia, db» _ oT 
+ = > Xo > 11492 ~ 471412 . 

a1, 412 ai; 4y2 

44, 42 4; 2 


The denominator for both x, and x, is simply the determinant of the coefficient matrix A. 
The determinant forming the numerator of x, can be obtained from A by replacing its first 
column by the column representing the constants of the system. The determinant forming 
the numerator of x, can be obtained in a similar way. These two determinants are denoted 


by |A,| and |A,], as follows. 
Te 
Dy Ay ay, by 
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EXAMPLE 3 


SOLUTION 


You have x, = and x, = ae This determinant form of the solution is called 
Cramer’s Rule. 
Using Cramer’s Rule 
Use Cramer’s Rule to solve the system of linear equations. 
4x, — 2x, = 10 
3%; = 34g = 11 


First find the determinant of the coefficient matrix. 
4 -2 

Al= le 

3 5 


Because |A| # 0, you know the system has a unique solution, and applying Cramer’s Rule 
produces 


ie 5 
A iW = =2 
lal s|_-28 _, 
|A| —14 —14 
; i 
|A,| 3 Il 14 
X= = 1 
“  |Al —14 —14 
The solution is x, = 2 and x, = —1. 


Cramer’s Rule generalizes easily to systems of n linear equations in n variables. The 
value of each variable is the quotient of two determinants. The denominator is the determi- 
nant of the coefficient matrix, and the numerator is the determinant of the matrix formed by 
replacing the column corresponding to the variable being solved for with the column 
representing the constants. For example, the solution for x, in the system 


AyjX1 + AyyXq + Ay3X, = D 
y)X1 + AyXy + Gy3X3, = dy 


Az)X1 + AzXq + A33X; = dD, 


THEOREM 3.11 
Cramer’s Rule 


EXAMPLE 4 
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If a system of n linear equations in n variables has a coefficient matrix with a nonzero 
determinant |A|, then the solution of the system is given by 


_ det(A,) _ det(A,) _ det(A,,) 


“1 aet(A)’? 2s det(A)? det)” 


where the ith column of A, is the column of constants in the system of equations. 


Let the system be represented by AX = B. Because |A| is nonzero, you can write 
x) 


1 : Xy 
X =A 'B=-— adj(A)B =| 7]. 


|A| 
Xn 
If the entries of B are b,, b,,. . ., b,, then x; is 
1 
7 a ja ercu + BC, +--+ + B,C), 


but the sum (in parentheses) is precisely the cofactor expansion of A,, which means that 
x; = |A,|/|A|, and the proof is complete. 


Using Cramer’s Rule 


SOLUTION 


Use Cramer’s Rule to solve the system of linear equations for x. 
—x+2y —3z= 
2x + z=0 
3x — 4y + 4z = 2 


The determinant of the coefficient matrix is 


-1 2 -3 
lAl=| 2 0 1/=10. 
3-4 4 


Because |A| # 0, you know the solution is unique, and Cramer’s Rule can be applied to 
solve for x, as follows. 


m2 -3 
m 0 1 jl 2 
m-4 4 MO) ; a _ ()(-1)(-8) _ 4 


10 ~ 10 10 5 
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REMARK: Try applying Cramer’s Rule in Example 4 to solve for y and z. You will see 


that the solution is y = -3 and z = -§ 


Area, Volume, and Equations of Lines and Planes 


Determinants have many applications in analytic geometry. Several are presented here. The 
first application is finding the area of a triangle in the xy-plane. 


Area of aTriangle The area of the triangle whose vertices are (x), y,), (%2, y2), and (x3, y3) is given by 
in the xy-Plane OY 1 
Area = +3 det X, “Vo 1}, 
X23 


where the sign (+) is chosen to yield a positive area. 


> 


PROOF Prove the case for y, > 0. Assume x, < x3 < x,and that (x;, y3) lies above the line segment 
connecting (x,, y,) and (x5, y,), as shown in Figure 3.1. Consider the three trapezoids whose 
(3, 3) vertices are 
Trapezoid 1: (x,, 0), (4, 91), (23, V3), (23, 0) 
Trapezoid 2: (x3, 0), (x3, y3)> (Xo Yo)» (x, 0) 
Trapezoid 3: (x,, 0), (x1, 91); (%5 Vo), (%>, 0). 


(X2, y2) 


1 ¥) The area of the triangle is equal to the sum of the areas of the first two trapezoids less the 


area of the third. So 


(x1,0) (x3, 0) (x2, 0) Area = ee + y3) (x5 a x) + Pa + alee ~ X3) a 54 + ya) (Xp a x) 


: 1 
Figure 3.1 = a(%¥2 + xy y3 + ZY. — X13 — X21 — 32) 


a 1 
1 
2\%2 = V2 : 
X33 1 
If the vertices do not occur in the order x, S x; < x, or if the vertex (x3, y3) is not above 


the line segment connecting the other two vertices, then the formula may yield the negative 
value of the area. 


EXAMPLE 5 
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Finding the Area of a Triangle 


SOLUTION 


}—> x 


Figure 3.2 


Test for Collinear Points 
in the xy-Plane 


Two-Point Form of the 
Equation of a Line 


Find the area of the triangle whose vertices are (1, 0), (2, 2), and (4, 3). 


It is not necessary to know the relative positions of the three vertices. Simply evaluate the 
determinant 


1 0 1 
32 2 1/=-3 
4 3 1 


and conclude that the area of the triangle is 2. 


Suppose the three points in Example 5 had been on the same line. What would have 
happened had you applied the area formula to three such points? The answer is that the 
determinant would have been zero. Consider, for instance, the collinear points (0, 1), (2, 2), 
and (4, 3), shown in Figure 3.2. The determinant that yields the area of the “triangle” having 
these three points as vertices is 


6 i 
1 

2 2 I1=0. 
4.3 jf 


If three points in the xy-plane lie on the same line, then the determinant in the formula for 
the area of a triangle turns out to be zero. This result is generalized in the test below. 


Three points (x,, y,), (x5, y>), and (x3, y3) are collinear if and only if 


x) Mil 1 
detl > 1} =0. 
X3 3 1 


The next determinant form, for an equation of the line passing through two points in the 
xy-plane, is derived from the test for collinear points. 


An equation of the line passing through the distinct points (x,, y,) and (x, y,) is given by 
any 1 
det|x, yj 1|=0. 
1 


X%y Y2 
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EXAMPLE 6| _ Finding an Equation of the Line Passing Through Two Points 


Find an equation of the line passing through the points (2, 4) and (— 1, 3). 


SOLUTION Applying the determinant formula for the equation of a line passing through two points 


produces 
x y 1 
2 4 1) = 0. 
=i 3 1 
To evaluate this determinant, expand by cofactors along the top row to obtain 
4 1 2 1 2 4 
43 | =| 1 | 3, ° 


x—3y+ 10=0. 
An equation of the line is x — 3y = — 10. 


The formula for the area of a triangle in the plane has a straightforward generalization 
to three-dimensional space, which is presented without proof as follows. 


Volume of a 
Tetrahedron 


EXAMPLE 7| _ Finding the Volume of a Tetrahedron 


Find the volume of the tetrahedron whose vertices are (0, 4, 1), (4,0, 0), (3,5, 2), and 
(2, 2, 5), as shown in Figure 3.3 (on page 167). 


SOLUTION 


Test for Coplanar Points 
in Space 


Three-Point Form of the 
Equation of a Plane 
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Figure 3.3 


Using the determinant formula for volume produces 


0 4 1 1 
4 0 O I_4y 
: = ¢(-72) = -12. 
|, 5 9 4| 76-72) 
¢ % & i 


The volume of the tetrahedron is 12. 


If four points in three-dimensional space happen to lie in the same plane, then the 
determinant in the formula for volume turns out to be zero. So, you have the test below. 


Four points (x,, ¥,,Z,), (X55 Vos Za)» (3, 3s Z3)> and (x4, 4, Z4) are coplanar if and only if 


xy yy ca 

x 4% 
det| ~ Y2 2 

X3 3 %3 


X44 £4 


el 


This test now provides the determinant form for an equation of a plane passing through 
three points in space, as shown below. 


An equation of the plane passing through the distinct points (x,, y,,z,), (%>, yo, Z), and 
(3, Y3> Fie) is given by 


G y g 1 

det ~ M1 a : = 0. 
xX Yo co) 1 
x3 ¥3 £3 1 


Chapter 3 Determinants 


EXAMPLE 8 


Finding an Equation of the Plane Passing Through Three Points 


Find an equation of the plane passing through the points (0, 1, 0), (—1, 3, 2), and (—2, 0, 1). 


SOLUTION 
x y z 

0) 1 0 

—1 3 2 

—2 0 1 


Se Se Se eS 


Using the determinant form of the equation of a plane passing through three points produces 


To evaluate this determinant, subtract the fourth column from the second column to obtain 


x yor 
0 0 0 
==" 2 2 
=2 =1 1 


Now, expanding by cofactors 


SES = eS eS 


along the second row yields 


2 2 —1 2 = 2 
r4 | - & = 9|23 | + ln ={/ 
which produces the equation 4x — 3y + 5z = —3. 


JaNe) eee Exercises 


The Adjoint of a Matrix 


In Exercises 1—8, find the adjoint of the matrix A. Then use the 
adjoint to find the inverse of A, if possible. 


ial? . 
3 4 


1 0 0 1 2 3 
af 2 6 we L =] 
0 -4 -12 2 2 2 
=3). 9s SST 0 1 
a] 2 4 3 ca] 1 2 3 
0 1 -1l =] =1 =2 
1 2 0 1 1 1 1 0 
zak =1 4 1 | 1 0 1 
0 0 1 2 1 0 1 1 
-1 1 1 2 0 1 1 1 


9. Prove that if |A] = 1 and all entries of A are integers, then all 
entries of |A~'| must also be integers. 
10. Prove that if an nxn matrix A is not invertible, then 
Aladj(A)] is the zero matrix. 


In Exercises 11 and 12, prove the formula for a nonsingular n x n 
matrix A. Assume n = 3. 


11. |adj(A)| = |A|"~! 12. adj[adj(A)] = |A|”~?A 
13. Illustrate the formula provided in Exercise 11 for the matrix 
Li | 
A= ‘ 
1 —-2 
14. Illustrate the formula provided in Exercise 12 for the matrix 
—1 3 
a=| i 
1 2 


15. Prove that if A is ann x n invertible matrix, then adj(A~!) = 
[adj(A)]~'. 


16. Illustrate the formula provided in Exercise 15 for the matrix 


Cramer’s Rule 


In Exercises 17—32, use Cramer’s Rule to solve the system of linear 
equations, if possible. 


17, x, +2x%,=5 18. 2x, — x, = —10 


Sor aya ll 3X, 2% = 1 
19. 3x, + 4x, = -2 20. 18x, + 12x, = 13 
5x, + 3x,= 4 30x, + 24x, = 23 
21. 20x, + 8x, = 11 22. 13x, — 6x, = 17 


12x, — 24x, = 21 26x, — 12x, = 8 
23. —0.4x, + 0.8x, = 1.6 24. —0.4x, + 0.8x, = 1.6 


2x, — 4x, = 5.0 0.2x, + 0.3x, = 0.6 

25. 3x, + 6x,= 5 26. 3x, + 2x, = 1 

6x, + 12x, = 10 2x, + 10x, = 6 
27, 4x, -— xX,- x= 1 28. 4x, — 2x, + 3x, = —2 

2x, + 2x, + 3x, = 10 2K, 2X -F Sy 16 

5xy = 2X5 = 2x5 = = 1 8x, — 5x,-—2x,= 4 
29. 3x, + 4x, + 4x3 = 11 30. 14x, — 21x, — 7x, = —21 

4x, — 4x, + 6x, = 11 4x, + 2x%,-2x,= 2 

6x, — 6x, = 3 56x, — 21x, + 7x, = 327 
31. 3x, + 3x, aq = 1 32. 2x, + 3x, 5x3 = 4 

3x, + 5x, 9x, = 2 3x, + 5x, 9x, = 7 

5x, + 9x, + 17x3 = 4 5x, + 9x, + 17x3 = 13 


In Exercises 33—42, use a graphing utility or a computer software 
program with matrix capabilities and Cramer’s Rule to solve for x,, 
if possible. 


33. —0.4x,+0.8x,=1.6 34. 0.2x,-0.6x,= 24 


2x,- 4x,= 5 —x, + 14x, = —8.8 
35. —tx, + 3x, = -2 36. 2x, — x, = —20 
2 r = ~22 3 — 3 = —Sl 


37. 4x, — x, + x3; = —5 38. 5x, — 3x, + 2x; = 2 
2x, + 2x, + 3x, = 10 20) F 2x5 = 3X5, 
5x, — 2x, + 6x, = 1 X, — 7x, + 8x, = —4 

— 2x, + x, = —29 

4x, + xX. — 3x3; = 37 


X, — 5x, + 2X3 = —24 


ll 
we 
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40. —8x, + 7x, — 10x, = —151 


12x, + 3x,- 5%,-= 86 
15x, — 9x, + 2x; = 187 
41. 3x, — 2x) + 9x3 + 4x,= 35 
=x, — 9x, — 6x, = —17 
3X3 X= 5 
2X, + 2X. + 8x,= —4 
42, ~~ 2 +X,= —8 
3x, + Sx, + Sx, = 24 
2h + X= =6 
2%) — BX — 3x5 == 15 
43. Use Cramer’s Rule to solve the system of linear equations for 
x and y. 
kx +(1—-—ky =1 
(1 — k)x + ky =3 


For what value(s) of & will the system be inconsistent? 


44. Verify the following system of linear equations in cos A, 
cos B, and cos C for the triangle shown in Figure 3.4. 


ccosB + bcosC =a 


ccosA +acosC=b 
bcosA + acosB =cC 


Then use Cramer’s Rule to solve for cos C, and use the result 
to verify the Law of Cosines, c? = a? + b? — 2ab cos C. 


€ 


A c B 
Figure 3.4 
Area, Volume, and Equations of Lines and Planes 


In Exercises 45—48, find the area of the triangle having the given 
vertices. 


45. (0, 0), (2, 0), (0, 3) 
47. (—1, 2), (2, 2), (—2, 4) 


46. (1, 1), (2, 4), (4, 2) 

48. (1, 1), (1, 1), (0, —2) 
In Exercises 49-52, determine whether the points are collinear. 
49. (1, 2), (3, 4), (5, 6) 50. (—1, 0), (1, 1), (3, 3) 
51. (—2, 5), (0, — 1), (3, —9) 

52. (—1, —3), (—4, 7), (2, —13) 
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In Exercises 53—56, find an equation of the line passing through the 
given points. 

53. (0, 0), (3, 4) 

55. (—2, 3), (—2, —4) 


54. (—4, 7), (2, 4) 

56. (1, 4), (3, 4) 

In Exercises 57—60, find the volume of the tetrahedron having the 
given vertices. 

57. (1, 0, 0), (0, 1, 0), (0, 0, 1), (1, 1, 1) 

58. (1, 1,1), ©, 0,0), @, 1, —1),(=1, 1,2) 

59. (3, —1, 1), 4, —4, 4), (, 1, 1), ©, 0, 1) 

60. (0, 0, 0), (0, 2, 0), (3, 0, 0), (1, 1, 4) 


In Exercises 61—64, determine whether the points are coplanar. 


61. (—4, 1, 0), (0, 1, 2), (4, 3, — 1), (0, 0, 1) 

62. (1, 2, 3),{=1, 0, 1), (0, =2, =5), 2,6, 11) 

63. (0, 0, —1), (0, —1, 0), (1, 1, 0), (2, 1, 2) 

64. (1, 2, 7), (—3, 6, 6), (4, 4, 2), (3, 3, 4) 

In Exercises 65—68, find an equation of the plane passing through 
the three points. 

65. (1, -2, 1), (-1, -1, 7), (2, -1, 3) 

66. (0, ~1, 0), (1, 1, 0), (2, 1,2) 

67. (0,0, 0), (1, —1, 0), (0, 1, -1) 

68. (1, 2, 7), (4, 4, 2), (3, 3, 4) 

In Exercises 69-71, Cramer’s Rule has been used to solve for one 
of the variables in a system of equations. Determine whether 


Cramer’s Rule was used correctly to solve for the variable. If not, 
identify the mistake. 


69. System of Equations Solve for y 


1 2 1 
—1 =2 
x+2y+ z=2 : 
4 1-1 
—x + 3y—2z=4 y= 
re eee 1 2 1 
= a a) 
4 6-1 
70. System of Equations Solve for z 
=i =4 =1 
x= 4y > 2-1 ee ot 
1 1-4 
2x-3y+ z= 6 eT Sy 
i a a 2-3 1 
1 1-4 


71. 


aD) 72. 


73s 


System of Equations Solve for x 


so 4 
a 

5x -2y+ z= 15 : 
a 
3x = 3y = ZEST x = 7, 
2x- y-=-3 7 
al: Sy 5 i 
a 


The table below shows the numbers of subscribers y 
(in millions) of a cellular communications company in the 
United States for the years 2003 to 2005. (Source: U.S. Census 
Bureau) 


Year Subscribers 
2003 158.7 
2004 182.1 
2005 207.9 


(a) Create a system of linear equations for the data to fit the 
curve y = at? + bt + c, where t is the year and t = 3 
corresponds to 2003, and y is the number of subscribers. 

(b) Use Cramer’s Rule to solve your system. 

(c) Use a graphing utility to plot the data and graph your 
regression polynomial function. 

(d) Briefly describe how well the polynomial function fits 
the data. 

The table below shows the projected values (in millions of 
dollars) of hardback college textbooks sold in the United States 
for the years 2007 to 2009. (Source: U.S. Census Bureau) 


Year Value 
2007 4380 
2008 4439 
2009 4524 


(a) Create a system of linear equations for the data to fit the 
curve y = at? + bt + c, where tf is the year and t = 7 
corresponds to 2007, and y is the value of the textbooks. 

(b) Use Cramer’s Rule to solve your system. 

(c) Use a graphing utility to plot the data and graph your 
regression polynomial function. 

(d) Briefly describe how well the polynomial function fits 
the data. 


In Exercises 1-18, find the determinant of the matrix. 


45) 13. 
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TVabdwem Review Exercises 


NWR NY RF WOO 


OrRrFRNEH 


0 0 0 0 2 
0 0 0 2 0 
18. | 0 0 2 0 0 
0 2 0 0 0 
2 0 0 0 0 


In Exercises 19-22, determine which property of determinants is 
illustrated by the equation. 


| 
19. = 
6 -=3)—" 
i 2 =4 (i =< 2 
20. /2 oO 3/= -]2 0 
4-1 1 4 1 =I 
a = =. 3 4 4 4 2 
0 4 6 1 Osi "se 4 
cae a er | rc, | a | 
ae) a | 63 =<) if 
1 i] jt 3 1 
22/0 -1 2=|2 5 4 
i oS a) it 2 4 


In Exercises 23 and 24, find (a) |A 
Then verify that |A||B| = |AB|. 


=! 2 3 4 
wae, Foe) 4 
0 1 2 1 


, (b) |B 


. (c) AB, and (d) |AB|. 


1 2 3 1 2 1 
24.A=|4 5 6|, B= |0 —-I1 1 
a 8 0 0 2 3 
In Exercises 25 and 26, find (a) |A7|, (b) |A3|, (c) |A7A|, and 
(d) |SA|. 
0 1 
-2 6 i 
25. A= 1 3 26. A=|-1 0 0 
2 1 2 
In Exercises 27 and 28, find (a) |A| and (b) |A~!]. 
i @ <8 2-1 4 
27. A= 0 3 2 28. A =| 5 0 3 


=2 ei 6 1 -2 0 
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In Exercises 29-32, find |A~'|. Begin by finding A~', and then 


evaluate its determinant. Verify your result by finding |A| and then 


applying the formula from Theorem 3.8, |A~!| = ay 

1 =] 10 2 
».[! w.['° 2] 

1 0 1 =1 1 2 
31.)2 —-1 4 32. 2 4 8 

2 6 0 1) 1 0 


In Exercises 33-36, solve the system of linear equations by each of 
the methods shown. 


(a) Gaussian elimination with back-substitution 
(b) Gauss-Jordan elimination 
(c) Cramer’s Rule 


334. 3x, + 3x, aS ea | 34. 2x, + x, + 2x, =6 
3x, + 5x, 9x, = 2 xX, + 2x, — 3x3 = 0 
5x, + 9x, + 17x3 = 4 3X FP 2ke— xy = 0 
35. x, + 2x%,- x, = —-7 36. 2x, + 3x, + 5x, = 4 
25 = lity = hy == 8 3x, + 5x, + 9x,= 7 
x, + 3x, +4x%,= 8 DX, + Oxy + 13%5 = 17 


In Exercises 37—42, use the determinant of the coefficient matrix 
to determine whether the system of linear equations has a unique 
solution. 


37. 5x + 4y = 2 38. 2x — Sy = 2 
—x+ y= 22 3x — Ty = 1 
39;-=% yr2z= 1 40. 2x + 3y + z= 10 
2x + 3y z= -2 24 = By > 32: 22 
Sx+4y+2z= 4 8x + 6y =-2 
41. x, + 2x, 6x, = 1 
2x, + 5x, + 15x3= 4 
3x, Xo 3x, = —6 
29) 42. x, + Sxy + 3x; =14 
IM dx, + 2x, + 5x, =o 
3x, + 8x, + 6x5 = 16 
2x, + 4x, —2x,= 0 
2x4 => = 0 


True or False? In Exercises 43 and 44, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, 
provide an example that shows the statement is not true in all cases 
or cite an appropriate statement from the text. 


43. (a) The cofactor C,, of a given matrix is always a positive 
number. 


(b) If a square matrix B is obtained from A by interchanging 
two rows, then det(B) = det(A). 
(c) If A is a square matrix of order n, then det(A) = —det(A’). 
44. (a) If A and B are square matrices of order n such that 
det(AB) = —1, then both A and B are nonsingular. 
(b) If A is a3 x 3 matrix with det(A) = 5, then det(2A) = 10. 
(c) If A and B are square matrices of order n, then 
det(A + B) = det(A) + det(B). 
45. If A is a3 x 3 matrix such that |A| = 2, then what is the value 
of |4A? 
46. If A is a 4 x 4 matrix such that |A] = —1, then what is the 
value of |2A|? 


47. Prove the property below. 


ay, Ao a3 

ay, A79 493) = 
G3, + C3, G39 + C3n_— 433 F C33 
4, Ayn Ay3 Gy, Ag 43 
Gy, Agy Ag3) + Ax, Ayn Ag 
43; 437 33 C3) C32 33 


48. Illustrate the property shown in Exercise 47 for the following. 


ik 0 2 
AS|P =1 3 SS ep = 0 4421 
2 1-1 


49, Find the determinant of the n x n matrix. 


l-n” 1 1 
1 1l-n 1 


1 1 1 


50. Show that 


= (a+ 3)(a — 1). 


— — ee 
— = QD — 
—_- QQ — — 
eT 


In Exercises 51-54, find the eigenvalues and corresponding 
eigenvectors of the matrix. 


—3 10 > 2 
[72 "| aft 3 

1 0 0 -3 0 4 
53./-2 3 0 54 2 1 1 

0 oO 4 -I oO 1 


Calculus In Exercises 55—58, find the Jacobians of the functions. 
If x, y, and z are continuous functions of u, v, and w with continu- 
ous first partial derivatives, the Jacobians J(u, v) and J(u, v, w) are 
defined as 


ax ax ax 
ax ox du dv dw 
du ov 7) ) 7) 

J(u, v) = and J(u,v,w)=|2 2 LY], 
yay du dv dw 
au ay az a a2 

du dv dw 

bs a $(v u), = $(v + u) 

56. x =au+bvy, y=cu+tdv 

57. x = S(u tv), y= $(u v), z= 2uvw 


58 x=u-vtw, y=2u, z=u+vt+w 


59. Writing Compare the various methods for calculating the 
determinant of a matrix. Which method requires the least 
amount of computation? Which method do you prefer if the 
matrix has very few zeros? 

60. Prove that if |A] = |B] # 0 and A and B are of the same size, 
then there exists a matrix C such that |C| = 1 and A = CB. 


The Adjoint of a Matrix 


In Exercises 61 and 62, find the adjoint of the matrix. 


0 1 1 =! 1 

61. | | 62. | 0 1 2 
=. 1 

0 0 =] 


Cramer’s Rule 


In Exercises 63-66, use the determinant of the coefficient matrix 
to determine whether the system of linear equations has a unique 
solution. If it does, use Cramer’s Rule to find the solution. 


63. 0.2x — 0.ly = 0.07 
0.4x — 0.5y = —0.01 

65. 2x, + 3x, 3x3 3 66. 4x, + 4x, + 4x, = 5 
6x, + 6x, + 12x, = 13 4x, — 2x, — 8x; = 1 

12x, + 9x, -— x3 = 2 8x, + 2x, — 4x; = 6 


64. 2x+ y= 03 
3x —y=-13 


2) 67. The table shows the projected populations (in millions) of the 


United States for the years 2010, 2020, and 2030. (Source: 
U.S. Census Bureau) 
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Year Population 
2010 308.9 
2020 335.8 
2030 363.6 


(a) Create a system of linear equations for the data to fit the 
curve y = af + bt + c, where t is the year and t = 10 
corresponds to 2010, and y is the population. 

(b) Use Cramer’s Rule to solve your system. 

(c) Use a graphing utility to plot the data and graph your 
regression polynomial function. 

(d) Briefly describe how well the polynomial function fits 
the data. 


42) 68. The table shows the projected amounts (in dollars) spent per 


person per year on basic cable and satellite television in the 
United States for the years 2007 through 2009. (Source: U.S. 
Census Bureau) 


Year Amount 
2007 296 
2008 308 
2009 321 


(a) Create a system of linear equations for the data to fit the 
curve y = at? + bt + c, where t is the year and t = 7 
corresponds to 2007, and y is the number of subscribers. 

(b) Use Cramer’s Rule to solve your system. 

(c) Use a graphing utility to plot the data and graph your 
regression polynomial function. 

(d) Briefly describe how well the polynomial function fits 
the data. 


Area, Volume, and Equations of Lines and Planes 


In Exercises 69 and 70, use a determinant to find the area of the 
triangle with the given vertices. 


69. (1, 0), (5, 0), (5, 8) 70. (—4, 0), (4, 0), (0, 6) 
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In Exercises 71 and 72, use the determinant to find an equation of 
the line passing through the given points. 


71. (—4, 0), (4, 4) 72. (2,5), (6, — 1) 


In Exercises 73 and 74, find an equation of the plane passing 
through the given points. 


73. (0,0, 0), (1, 0, 3), (0, 3, 4) 
74. (0, 0, 0), (2, -1, 1), (—3, 2, 5) 


True or False? In Exercises 75 and 76, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, 
provide an example that shows the statement is not true in all cases 
or cite an appropriate statement from the text. 


75. (a) In Cramer’s Rule, the value of x, is the quotient of two 
determinants, where the numerator is the determinant of 
the coefficient matrix. 

(b) Three points (x, y,), (%, y2), and (x3, y3) are collinear if 
the determinant of the matrix that has the coordinates as 
entries in the first two columns and 1’s as entries in the 
third column is nonzero. 

76. (a) If A is a square matrix, then the matrix of cofactors of A is 
called the adjoint of A. 

(b) In Cramer’s Rule, the denominator is the determinant of 
the matrix formed by replacing the column corresponding 
to the variable being solved for with the column represent- 
ing the constants. 


GUN aiaiweme Projects 


1 Eigenvalues and Stochastic Matrices 


In Section 2.5, you studied a consumer preference model for competing cable 
television companies. The matrix representing the transition probabilities was 


0.70 
P= 0:20 
0.10 


0.15 
LIS ||, 
0.70 


When provided with the initial state matrix X, you observed that the number of 
subscribers after 1 year is the product PX. 


15,000 
X = | 20,000 
65,000 


— > PX =| 0.20 0.80 


0.70 0.15 0.15 | | 15,000 239250) 
0.15 | | 20,000 | = | 28,750 


0.10 0.05 0.70 | 65,000 48,000 


After 10 years, the number of subscribers had nearly reached a steady state. 


15,000 
X = | 20,000 
65,000 


33,287 


— > PX =| 47,147 


19,566 


That is, for large values of n, the product P"X approaches a limit X, PX = X. 


From your knowledge of eigenvalues, this means that | is an eigenvalue of P with 
corresponding eigenvector X. 


1. Use a computer or calculator to show that the eigenvalues and eigenvectors 
of P are as follows. 
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Nay = OG, = 15S 


i] 0 — 2) 
x = |UOhes =| Kl bes = 1 
4 1 1 


2. Let S be the matrix whose columns are the eigenvectors of P. Show that 
S~'!PS is a diagonal matrix D. What are the entries along the diagonal of D? 

3. Show that P” = (SDS~')" = SD"S~!. Use this result to calculate P!°X and 
verify the result from Section 2.5. 


2 The Cayley-Hamilton Theorem 
The characteristic polynomial of a square matrix A is given by the determinant 
|Al — A|. If the order of A is n, then the characteristic polynomial p(A) is an 
nth-degree polynomial in the variable 2. 
As det N= 2A) SNe ee a ea eke ie Nica 
The Cayley-Hamilton Theorem asserts that every square matrix satisfies its 
characteristic polynomial. That is, for the n x n matrix A, 
pA) SAP +t eA eee eA cA el = 0; 
Note that this is a matrix equation. The zero on the right is the n x n zero matrix, 
and the coefficient cy) has been multiplied by the n x n identity matrix J. 
1. Verify the Cayley-Hamilton Theorem for the matrix 


Ls ol 


2. Verify the Cayley-Hamilton Theorem for the matrix 


6 0 4 
ep) 1 3 |. 
2 0 4 


3. Prove the Cayley-Hamilton Theorem for an arbitrary 2 x 2 matrix A, 


eal 

A= E 

c d 

4. If A is nonsingular and p(A) =A” +c,_,A" 1+---+cA+c)l= 0, 
show that 


1 
AW! = =(—=40"! = @ 


Co 


A"? ++ += 6A — cl). 


i=l 
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Use this result to find the inverse of the matrix 


a=, sl 


. The Cayley-Hamilton Theorem can be used to calculate powers A” of the 


square matrix A. For example, the characteristic polynomial of the matrix 


=| 
ee) 
2 =I 
iS A) = 22 = PA = iL 
The Cayley-Hamilton Theorem implies that 


A2—2A —I1=0 or A2=2A +7. 


So, A? is shown in terms of lower powers of A. 


ll 1 =2 
eno TE fa 
21 0 1 4 = 


Similarly, multiplying both sides of the equation A? = 2A + J by A gives 
A? in terms of lower powers of A. Moreover, you can write A? in terms of 
just A and J after replacing A? with 2A + J, as follows. 


A? = 2A2+A=2(2A +1) +A=5A4 2 


(a) Use this method to find A? and A*. (First write A*+ as a linear combina- 
tion of A and /—that is, as a sum of scalar multiples of A and /.) 
(b) Find A> for the matrix 


0 0 1 
2 2 Tih, 
1 0 2 


(Hint: Find the characteristic polynomial of A, then use the Cayley- 
Hamilton Theorem to express A? as a linear combination of A?, A, and 
I. Inductively express A> as a linear combination of A?, A, and J.) 


Chapters 1-3 Cumulative Test 177 


Vie wees Cumulative Test 


Take this test as you would take a test in class. When you are finished, check your work against the 
answers provided in the back of the book. 


il, 


Solve the system of linear equations. 
4x, + x, — 3x;= 11 

2X4 = 3x5 °F 2x, = 9 

x X5 X= -=3 


. Find the solution set of the system of linear equations represented by the augmented 


matrix. 
0 joe | 0 2 
1 0 2. =] 0 
1 2 0 -1 4 


. Solve the homogeneous linear system corresponding to the coefficient matrix below. 


1 2 1 -2 
0 0 2 -4 
-2 -4 1 -2 


. Find conditions on k such that the system is consistent. 


x+2y-—z=3 
—x- y+z= 
x ytz=k 


. A manufacturer produces three different models of a product that are shipped to two 


different warehouses. The number of units of model i that are shipped to warehouse j 
is represented by a,; in the matrix 


200 300 
A=}|600 350}. 

250 400 
The prices of the three models in dollars per unit are represented by the matrix 
B = [12.50 9.00 21.50]. 


Find the product BA and state what the entries of the product represent. 


. Solve for x and y in the matrix equation 2A — B = J if 


ie i | 
A= and B= : 
2 3 y i) 


. Find A‘A for the matrix 


1 2 3 
A= F 
li 2) s| 


. Find the inverses (if they exist) of the matrices. 


2 3 2 3 
@ || | On s| 


. Find the inverse of the matrix 


1 1 0 
=3 6 5}. 
0 1 0 
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10. 


11. 


12. 


13. 


14. 


15. 


16. 


17. 


18. 
19. 


20. 


21. 
22. 
23. 


Factor the matrix 


Lol 
A= 
1 0 
into a product of elementary matrices. 
Find the determinant of the matrix 
) 1 2 4 
1 0 =2: =3 
1 1 6 1} 
1 0 0 —-4 
Find each determinant if 
{ = =2 1 
A= | | and B= | | 
4 2 0 ) 
(a) |A| (b) |B| (c) |AB| (d) |A“}| 
If |A] = 7 and A is of order 4, then find each determinant. 


(a) |3A| (b) |A7| (c) |A7}| (d) |A3| 
Use the adjoint of 
il =5° =i 
A=|0 -2 1 
1 0 2 
to find A7!. 
Let x), X,, X;, and b be the column matrices below. 
1 1 0 1 
x, =|0 x, =]1 x, =|1 b=/|2 
1 0 1 3 


Find constants a, b, and c such that ax, + bx, + cx, = b. 


Use linear equations to find the parabola y = ax* + bx + c that passes through the 
points (—1, 2), (0, 1), and (2, 6). Sketch the points and the parabola. 


Use a determinant to find an equation of the line passing through the points (1, 4) and 
(5, —2). 
Use a determinant to find the area of the triangle with vertices (3, 1), (7, 1), and (7, 9). 
Find the eigenvalues and corresponding eigenvectors of the matrix below. 
1 4 6 
1 2 2 
-1 -2 —-4 
Let A, B, and C be three nonzero n x n matrices such that AC = BC. Does it follow 
that A = B? Prove your answer. 
For any matrix B, prove that the matrix B’B is symmetric. 
Prove that if the matrix A has an inverse, then the inverse is unique. 
(a) Define row equivalence of matrices. 


(b) Prove that if A is row-equivalent to B and B is row-equivalent to C, then A is 
row-equivalent to C. 
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Vectors in R” 

Vector Spaces 
Subspaces of Vector 
Spaces 

Spanning Sets and 
Linear Independence 
Basis and Dimension 
Rank of a Matrix and 
Systems of Linear 
Equations 
Coordinates and Change 
of Basis 

Applications of Vector 
Spaces 


Vector Spaces 


C 


HAPTER OBJECTIVES 


Perform, recognize, and utilize vector operations on vectors in R”. 


Determine whether a set of vectors with two operations is a vector space and recognize 
standard examples of vector spaces, such as: R", Mm» Pry P, C(— 00, 00), C[a, b]. 


Determine whether a subset W of a vector space V is a subspace. 

Write a linear combination of a finite set of vectors in V. 

Determine whether a set S of vectors in a vector space V is a spanning set of V. 
Determine whether a finite set of vectors in a vector space V is linearly independent. 
Recognize standard bases in the vector spaces R”, M,,,,, and P.,. 

Determine if a vector space is finite dimensional or infinite dimensional. 

Find the dimension of a subspace of R”, M,,,,, and P,,. 


Find a basis and dimension for the column or row space and a basis for the nullspace (nullity) 
of a matrix. 


Find a general solution of a consistent system Ax = b in the form x, + Xp. 
Find [x], in R", M,,,,» and P,,. 

Find the transition matrix from the basis B to the basis B’ in R". 

Find [x],, for a vector x in R”. 


Determine whether a function is a solution of a differential equation and find the general 
solution of a given differential equation. 


Find the Wronskian for a set of functions and test a set of solutions for linear independence. 


Identify and sketch the graph of a conic or degenerate conic section and perform a rotation 
of axes. 


4.1 | Vectors in R” 


In physics and engineering, a vector is characterized by two quantities (length and 
direction) and is represented by a directed line segment. In this chapter you will see that 
these are only two special types of vectors. Their geometric representations can help you 
understand the more general definition of a vector. 


This section begins with a short review of vectors in the plane, which is the way 


vectors were developed historically. 
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(x4, ¥2) 
Terminal 
point 


Figure 4.1 


Initial point 


EXAMPLE 1 


Vectors in the Plane 


A vector in the plane is represented geometrically by a directed line segment whose 
initial point is the origin and whose terminal point is the point (x,, x,), as shown in Figure 
4.1. This vector is represented by the same ordered pair used to represent its terminal 
point. That is, 


x = (x, x). 
The coordinates x, and x, are called the components of the vector x. Two vectors in the 


plane u = (u,, u,) and v = (v,, v,) are equal if and only if u, = v, and u, = vy. 


REMARK: The term vector derives from the Latin word vectus, meaning “‘to carry.” The 
idea is that if you were to carry something from the origin to the point (x,, x), the trip could 
be represented by the directed line segment from (0, 0) to (x,, x5). Vectors are represented 
by lowercase letters set in boldface type (such as u, v, w, and x). 


Vectors in the Plane 


SOLUTION 


(uy + V1, U2+ V2) 


Figure 4.3 


ae 
V1 uy 
Vector Addition 


Use a directed line segment to represent each vector in the plane. 
(a) u = (2,3) = (b) v= (— 1,2) 


To represent each vector, draw a directed line segment from the origin to the indicated 
terminal point, as shown in Figure 4.2. 


(a) (b) 
Figure 4.2 


The first basic vector operation is vector addition. To add two vectors in the plane, add 
their corresponding components. That is, the sum of u and v is the vector 


u + v= (u,, U5) + (yj, v) = (uy, + V4, Uy + V9). 


Geometrically, the sum of two vectors in the plane is represented as the diagonal of a 
parallelogram having u and v as its adjacent sides, as shown in Figure 4.3. 

In the next example, one of the vectors you will add is the vector (0, 0), called the zero 
vector. The zero vector is denoted by 90. 


EXAMPLE 2 


Adding Two Vectors in the Plane 


FM 


Simulation 

Explore this concept further with an 
electronic simulation available on 
the website college.hmco.con/ 
pic/larsonELAG6e. Please visit this 
website for keystrokes and program- 
ming syntax for specific graphing 
utilities and computer software 
programs applicable to Example 2. 
Similar exercises and projects are 
also available on this website. 


SOLUTION 


PS 


v 
c<0 
> XxX 
cv 
e 
Figure 4.5 
EXAMPLE 3 


Find the sum of the vectors. 
(a) u = (1,4), v = (2, —2) 


b) a= G, 


(a) u + v = (1,4) + (2, —2) = (3, 2) 
(b) u + v = (3, —2) + (—3, 2) = (0, 0) 


(c) u+ v = (2,1) + (0,0) = (2, 1) 
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3,2) (c) u= (2,1), v = (0,0) 


Figure 4.4 gives the graphical representation of each sum. 


(a) (b) (c) 
y 
A 
at 904 
3+f Ss. 
2+f/u _e(3, 2) 
: —Autv 
ttt tH}+—> x 
=3-2-1 213 4 
2+ © 
Gh ee) 
a4 4. 
Figure 4.4 


The second basic vector operation is called scalar multiplication. 
v by a scalar c, multiply each of the components of v by c. That is, 


cv = c(vy, Vy) = (cv, cv5). 


To multiply a vector 


Recall from Chapter 2 that the word scalar is used to mean a real number. Historically, this 
usage arose from the fact that multiplying a vector by a real number changes the “scale” of 
the vector. For instance, if a vector v is multiplied by 2, the resulting vector 2v is a vector 
having the same direction as v and twice the length. In general, for a scalar c, the vector cv 
will be Ic| times as long as v. If c is positive, then cv and v have the same direction, and 


if c is negative, then cv and v have opposite directions. This is shown in Figure 4.5. 


The product of a vector v and the scalar — 1 is denoted by 


—v =(-Dv. 


The vector — v is called the negative of v. The difference of u and v is defined as 


u-—-v=u+(-vy), 


and you can say v is subtracted from u. 


Operations with Vectors in the Plane 


Provided with v = (—2, 5) and u = (3, 4), find each vector. 


(a) qv. (by u-v 


(c) Sv +u 
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13 
72 
(—2, 5) 1 
e aVvtu 
Vv 9 (3, 4) 
ah 
(-1.5)§ | 
1\ 
2 

+H t+» x 

=3-9 = Te 6 

=p O,-=) 

Figure 4.6 

THEOREM 4.1 


Properties of Vector 
Addition and Scalar 
Multiplication in 
the Plane 


PROOF 


(a) Because v = (—2, 5), you have 
av = (3(—2), 35) = (- 1,3). 
(b) By the definition of vector subtraction, you have 
u — v= (3 — (—2),4 — 5) = (5, -1). 
(c) Using the result of part(a), you have 
ty +u=(-1,3) + 3,4) =(-1 + 3,344) = (2,49). 


Figure 4.6 gives a graphical representation of these vector operations. 


Vector addition and scalar multiplication share many properties with matrix addition and 
scalar multiplication. The ten properties listed in the next theorem play a fundamental role 
in linear algebra. In fact, in the next section you will see that it is precisely these ten prop- 
erties that have been abstracted from vectors in the plane to help define the general notion 
of a vector space. 


Let u, v, and w be vectors in the plane, and let c and d be scalars. 


— 


u + vis a vector in the plane. Closure under addition 


ut+v=vtu Commutative property of addition 
(u + vy) +w=u+(v+w) Associative property of addition 
u+0=u Additive identity property 

u + (—u) =0 Additive inverse property 


cu is a vector in the plane. 
c(Uu + vy) = cu+cv 

(c + du = cu + du 
c(du) = (cd)u 

1(u) =u 


Closure under scalar multiplication 
Distributive property 
Distributive property 


NSS) ON Se pS IS 


Associative property of multiplication 


S 


Multiplicative identity property 


The proof of each property is a straightforward application of the definition of vector 
addition and scalar multiplication combined with the corresponding properties of addition 
and multiplication of real numbers. For instance, to prove the associative property of vector 
addition, you can write 
(u + v) + w= [(u, us) + (4, v2)] + (Wy, wo) 

= (uy + Vy, Uy + v2) + (Wy, Wy) 

= ((u, + v,) + wy, (uy + v5) + ws) 

= (u, + (v, + wy), Uy + (vy + W)) 

= (uy, Uy) + (vy, + W), v2 + Wy) 

= (uy, Uy) + [(y), v2) + (Wy, w>)] 
u + (v + w). 


REMARK: Note that the 
associative property of vector 
addition allows you to write 
such expressions as u + v + w 
without ambiguity, because you 
obtain the same vector sum 
regardless of which addition is 
performed first. 


HISTORICAL NOTE 


William Rowan Hamilton 
(1805-1865) 

is considered to be Ireland’s most 
famous mathematician. His work 
led to the development of 
modern vector notation. We still 
use his i, j, and k notation today. 
To read about his work, visit 
college.hmco.com/pic/larsonELA6e. 


Definitions of Vector 
Addition and Scalar 
Multiplication in R" 
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Similarly, to prove the right distributive property of scalar multiplication over addition, 
(c + du = (c + d)(u;, uy) 
= ((c + du, (c + dus) = (cu, + du,, cu, + dus) 
= (cu,, cuz) + (du,, duy) = c(u,, uy) + d(uy, uy) 
=cu+ du. 


The proofs of the other eight properties are left as an exercise. (See Exercise 61.) 


Vectors in R” 


The discussion of vectors in the plane can now be extended to a discussion of vectors in 
n-space. A vector in n-space is represented by an ordered n-tuple. For instance, an ordered 
triple has the form (x,,x>,.x3), an ordered quadruple has the form (x,,.x,,x3,X,), and a 
general ordered n-tuple has the form (x), x5,.x3,. . .,%,). The set of all n-tuples is called 
n-space and is denoted by R’. 


R! = 1-space = set of all real numbers 


R? = 2-space = set of all ordered pairs of real numbers 


R? = 3-space = set of all ordered triples of real numbers 
R* = 4-space = set of all ordered quadruples of real numbers 
R" = n-space = set of all ordered n-tuples of real numbers 


The practice of using an ordered pair to represent either a point or a vector in R? 
continues in R”. That is, an n-tuple (x,, x,,X3,. . .,x,) can be viewed as a point in R” with 


the x,’s as its coordinates or as a vector 


Vector in R” 


SS Gi. 46e8) 


with the x,’s as its components. As with vectors in the plane, two vectors in R” are equal if 
and only if corresponding components are equal. [In the case of n = 2 or n = 3, the 
familiar (x, y) or (x, y, z) notation is used occasionally. ] 

The sum of two vectors in R” and the scalar multiple of a vector in R” are called the 
standard operations in R” and are defined as follows. 


Let u = (u,, uy, u3,. . ., u,) and v = (v,, vy, v3,. . ., v,) be vectors in R” and let c be 
a real number. Then the sum of u and v is defined as the vector 

(SE WY = (Hy FP Wha Wy FP Wp Wy IP Vay o oy, ar Wah 
and the scalar multiple of u by c is defined as the vector 


CU (Cia, Cincy ec) 
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As with 2-space, the negative of a vector in R” is defined as 


u =( u,, Uy, Uz,.. ., —U,) 


and the difference of two vectors in R” is defined as 


U — V = (uy, — Vj, Uy — Vo, U3 — Vp. . Uy — Vy): 


The zero vector in R” is denoted by 0 = (0,0,. . ., 0). 


EXAMPLE 4| Vector Operations in R? 


Provided that u = (—1, 0, 1) and v = (2, —1, 5) in R?, find each vector. 
(a) uty (b) 2u (c) v— 2u 


(1,-1,6) ~ SOLUTION (a) To add two vectors, add their corresponding components, as follows. 
u + v= (1,0, 1) + (2, -1,5) = (1, -1,6) 
(b) To multiply a vector by a scalar, multiply each component by the scalar, as follows. 


2u = 2(—1,0, 1) = (—2, 0, 2) 


(4, —1, 3); 
(c) Using the result of part (b), you have 


v — 2u = (2, -1,5) — (2,0, 2) = (4, 1, 3). 


— 
7 
Lele 
ae 


Figure 4.7 gives a graphical representation of these vector operations in R°. 


Figure 4.7 


Technolo gy Some graphing utilities and computer software programs will perform vector addition and scalar 

Note multiplication. Using a graphing utility, you may verify Example 4 as follows. Keystrokes and 
programming syntax for these utilities/programs applicable to Example 4 are provided in the 
Online Technology Guide, available at college.hmco.com/pic/larsonELA6e. 


WECTOR: U WECTOR: Ww 
eq=-l e1=2 
e:=H ez= 71 
es=1 e=5 


THEOREM 4.2 
Properties of Vector 
Addition and Scalar 
Multiplication in R" 


EXAMPLE 5 
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The following properties of vector addition and scalar multiplication for vectors in R” are 
the same as those listed in Theorem 4.1 for vectors in the plane. Their proofs, based on the 
definitions of vector addition and scalar multiplication in R”, are left as an exercise. (See 
Exercise 62.) 


Let u, v, and w be vectors in R”, and let c and d be scalars. 


1. u + visa vector in R”. Closure under addition 
2utv=vt+u Commutative property of addition 
3.(ut+v)+w=ut (v at w) Associative property addition 
4,.u+0=u Additive identity property 

Sp tl se (—u) =0 Additive inverse property 

6. cu is a vector in R”. Closure under scalar multiplication 
7. cu +v) =cu+cv Distributive property 

8. (c + du = cu + du Distributive property 

9. c(du) = (cd)u Associative property of multiplication 
10. 1(u) =u Multiplicative identity property 


Using the ten properties from Theorem 4.2, you can perform algebraic manipulations with 
vectors in R” in much the same way as you do with real numbers, as demonstrated in the 
next example. 


Vector Operations in R* 


SOLUTION 


Let u = (2, —1,5,0), v = (4,3, 1, — 1), and w = (—6, 2, 0, 3) be vectors in R*. Solve 
for x. 
(a) x = 2u — (v + 3w) (b) 3(x + w) = 2u-v+x 


(a) Using the properties listed in Theorem 4.2, you have 
x = 2u — (v + 3w) 
= 2u — v— 3w 
= (4, —2, 10,0) — (4,3, 1, —1) — (—18, 6, 0, 9) 
=(4-4+ 18,-2-3-6,10-1-0,0+1-9) 
= (18, —11, 9, —8). 


(b) Begin by solving for x as follows. 
3(x + w) = 2u-v+x 
3x + 3w = 2u-v+x 

3x — x = 2u-—v- 3w 
2x = 2u — v — 3w 


x = 3(2u — v — 3w) 
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THEOREM 4.3 
Properties of 
Additive Identity and 
Additive Inverse 


PROOF 


Using the result of part (a) produces 


x = 3(18, —11, 9, —8) 
= (0,-4.3, -4) 


The zero vector 0 in R” is called the additive identity in R”. Similarly, the vector — v is 
called the additive inverse of v. The theorem below summarizes several important proper- 
ties of the additive identity and additive inverse in R”. 


Let v be a vector in R”, and let c be a scalar. Then the following properties are true. 


1. The additive identity is unique. That is, if v + u = v, then u = 0. 

2. The additive inverse of v is unique. That is, if v + u = 0, then u = —v. 
3. Ov=0 

4. c0=0 

5. If cv = 0, then c = Oorv = 0. 

6. —(-—v) =v 


To prove the first property, assume v + u = v. Then the steps below are justified by 
Theorem 4.2. 


vt+u=v Given 
(v+u) + (-v) =v + (—v) Add —y to both sides. 
(v+u)+(-v) =0 Additive inverse 
v+[u+(-v)]=0 Associative property 
v+([(-v) + ul] =0 Commutative property 
Iv+(-v)]+u=0 Associative property 
0+u=0 Additive inverse 
u+0=0 Commutative property 
u=0 Additive identity 


As you gain experience in reading and writing proofs involving vector algebra, you will not 
need to list this many steps. For now, however, it’s a good idea. The proofs of the other five 
properties are left as exercises. (See Exercises 63-67.) 


REMARK: In Properties 3 and 5 of Theorem 4.3, note that two different zeros are used, 
the scalar 0 and the vector 0. 


The next example illustrates an important type of problem in linear algebra—writing one 
vector x as the sum of scalar multiples of other vectors v,, v5,. . ., and v,,. That is, 
X= CV, + CyVn T+ + + + C,Y,. 


The vector x is called a linear combination of the vectors v,, v,,. . ., and v,. 


EXAMPLE 6 
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Writing a Vector as a Linear Combination of Other Vectors 


SOLUTION 


Discovery 


Provided that x = (—1, —2, —2), u = (0, 1, 4), v = (—1, 1, 2), and w = (3, 1, 2) in R°, 
find scalars a, b, and c such that 


x = au + bv + cw. 


By writing 
x u v Ww 


A 


la ar * ‘¢ 


(—1, —2, —2) = a(0, 1, 4) + b(-1, 1, 2) + c(3, 1, 2) 
(-b + 3c,a+b+c,4a + 2b + 2c), 


you can equate corresponding components so that they form the system of three linear 
equations in a, b, and c shown below. 


—-b+3c=-1 Equation from first component 
a+ b+ c=-2 Equation from second component 
4a+2b+ 2c = -—2 Equation from third component 


Using the techniques of Chapter 1, solve for a, b, and c to get 
a=1, b=-2, and c=-—l. 

x can be written as a linear combination of u, v, and w. 
x=u-2v-w 


Try using vector addition and scalar multiplication to check this result. 


Is the vector (1, 1) a linear combination of the vectors (1,2) and (—2, — 4)? Graph these vectors 
in the plane and explain your answer geometrically. Similarly, determine whether the vector (1, 1) 
is a linear combination of the vectors (1, 2) and (2, 1). What is the geometric significance of these 
two questions? Is every vector in R? a linear combination of the vectors (1, 2) and (2, 1)? Give a 


geometric explanation for your answer. 


You will often find it useful to represent a vector u = (u,,u,,. . ., u,) in R" as either a 


1 x n row matrix (row vector), 
u=[u, uw---u,), 


or ann x 1 column matrix (column vector), 
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This approach is valid because the matrix operations of addition and scalar multiplication 
give the same results as the corresponding vector operations. That is, the matrix sums 


u+v=[u, uw 


=[u,+v, 
and 
uy 
Uy 
utv=]-]+ 
u 


Uy + V5 


Un] 2 Lv, Vo ae Vy 
u, + v,] 

uy + Vy 

Uy + Vo 

U, + Vy 


yield the same results as the vector operation of addition, 


utv=(u,u,,.. 


a u,,) + (v,, Vinceng 


Fer v,) = (u, FV, Uy + Vo,.. -,Uu, + v,)« 


The same argument applies to scalar multiplication. The only difference in the three notations 
for vectors is how the components are displayed; the underlying operations are the same. 


Sate) Exercises 


In Exercises | and 2, find the component form of the vector shown. 


1. y 


In Exercises 3—6, use a directed line segment to represent the vector. 


3. u = (2, —4) 4. v = (—2, 3) 


5. u = ( -3, —4) 6. v = (—2, —5) 


In Exercises 7—10, find the sum of the vectors and illustrate the 
indicated vector operations geometrically. 


8 u = (-1,4), v = (4, -3) 


7. u = (1,3), v = (2, -2) 
9. u = (2, —3), v = (—-3, -1) 
10. u = (4, —2), v = (—2, —3) 


In Exercises 1 1—16, find the vector v and illustrate the indicated vector 
operations geometrically, where u = (—2, 3) and w = (—3, —2). 
11. vy = ju 12,.v=u+w 13. v=u+ 2w 
14.v=-u+w 15. v = 33u + w) 16. v=u—- 2w 
17. Given the vector v = (2, 1), sketch (a) 2v, (b) — 3v, and (c) sv. 
18. Given the vector vy = (3, —2), sketch (a) 4v, (b) —ty, and (c) Ov. 
In Exercises 19—24, let u = (1, 2,3), v = (2, 2, — 1), and 

w = (4,0, —4). 


20. Find u — v + 2w. 
22. Find 5u — 3v — 5w. 


19. Find u — vandv — u. 

21. Find 2u + 4v — w. 

23. Find z, where 2z — 3u = w. 
24. Find z, where 2u + v — w+ 3z = 0. 


25. Given the vector v = (1, 2, 2), sketch (a) 2v, (b) —v, and (c) SV. 
26. Given the vector v = (2, 0, 1), sketch (a) — v, (b) 2v, and (c) 5V. 
27. Which of the vectors below are scalar multiples of 
z = (3,2, —5)? 
(a) u = (—6, —4, 10) 
(b) v = (2,3, —4) 
(c) w = (6, 4, 10) 


28. Which of the vectors below are scalar multiples of 
1 23 


z= G. - 3> 4)? 

(a) u = (6, —4, 9) 

b) v= (-1,3,—3) 

(c) w = (12, 0, 9) 
In Exercises 29-32, find (a) u — v, (b) 2(u + 3v), and (c) 2v — u. 
29. u = (4,0, —3,5), v = (0,2, 5, 4) 
30. u = (0, 4, 3,4, 4), v = (6, 8, —3, 3, —5) 
31. u = (—7, 0,0,0,9), v = (2, —3, —2, 3, 3) 
32. u = (6, —5,4,3), v = (-2,3, -4,-1) 
In Exercises 33 and 34, use a graphing utility with matrix capabili- 
ties to find the following, where u = (1, 2, —3, 1), 


v = (0,2, —1, —2), and w = (2, —2, 1, 3). 
33. (a) u + 2v 34. (a) v + 3w 
(b) w — 3u (b) 2w — ju 
(c) 4v + 5 su—w (c) 2u + w — 3v 


(d) {Gu + 2v — w) (d) 3(4v — 3u + w) 


In Exercises 35-38, solve for w provided that u = (1, — 1, 0, 1) and 


v = (0, 2, 3, —1). 
35. 2w = u — 3v 36. w+u=-—v 
37s sw = 2u + 3v 38. w + 3v = —2u 


In Exercises 39—44, write v as a linear combination of u and w, if 
possible, where u = (1, 2) and w = (1, —1). 


39. v = (2, 1) 40. v = (0, 3) 
41. v = (3,0) 42. v = (1, -1) 
43, v = (—1, —2) 44, v = (1, —4) 


In Exercises 45 and 46, find w such that 2u + v — 3w = 0. 


45. u = (0,2,7,5), v = (—3, 1,4, —8) 
46. u = (0,0, —8, 1), v = (1, —8,0,7) 
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In Exercises 47—50, write v as a linear combination of u,, u,, and u;, 
if possible. 


47. u, = (2, 3; 5), uo = (1, 2, 4), u, = (-2, 2; 3), 
v = (10, 1,4) 


48. u, = (1, 3,5), w = (2,—1,3), uw, = (—3,2, —4), 


v = (-1,7, 2) 

49. u, = (1,1,2,2), u, = (2,3,5,6), u, = (-3, 1, —4,2), 
v = (0,5, 3, 0) 

50. u, = (1,3,2, 1), u, = (2,—2,—5,4), u, = (2, —1,3,6), 
v = (2,5, —4, 0) 


49) In Exercises 51-54, use a graphing utility or computer software 


program with matrix capabilities to write v as a linear combination of 
U,, U5, U;,U,, and us, or of U,, U5, U5, Uy, Us, and uy. Then verify your 
solution. 


51. u, = (1,2, —3, 4, -1) 52. u, = (1, 1, -1,2, 1) 
es Pea aa u, = (2, 1,2, -1, 1) 
u; = (0, 1, 1, 1, —4) u, = (1, 2, 0, 1, 2) 
u, = (2, 1, —1,2, 1) u, = (0, 2, 0, 1, —4) 
u, = (0,2, 2, —1, —1) u; = (1, 1,2, —1, 2) 
v = (5,3, —11, 11,9) v = (5,8, 7, —2, 4) 


53. u, = (1,2, —3, 4, —1, 2) 
a= (1,-2.1, 2,1) 


u, = (0,2, -1,2, -1, -D) 
u, = (1, 0, 3, —4, 1, 2) 
ne= (1, =2,. 1, =1,2, =) 


2, 
u,; = G, 2, 1, —2, 3, 0) 
v = (10, 30, — 13, 14, —7, 27) 


54. u, = (1, —3, 4, —5, 2, -1) 
3 


eae =21) 
u, = (1, 1,1, -1,4, -1) 

u, = (3, -1,3,- 2, 3) 

u; = (1, —2, 1,5, —3, 4) 
u, = (4,2, -1,3, -1, 1) 

v = (8, 17, —16, 26, 0, —4) 


True or False? In Exercises 55 and 56, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


55. (a) Two vectors in R” are equal if and only if their correspon- 
ding components are equal. 
(b) For a nonzero scalar c, the vector cv is c times as long as 
v and has the same direction as v if c > O and the opposite 
direction if c < 0. 
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56. (a) To add two vectors in R", add their corresponding 
components. 
(b) The zero vector 0 in R” is defined as the additive inverse of 
a vector. 


In Exercises 57 and 58, the zero vector 0 = (0,0,0) can be 
written as a linear combination of the vectors v,, Vv, and v3; as 
0 = Ov, + Ov, + Ov;. This is called the trivial solution. Can you 
find a nontrivial way of writing 0 as a linear combination of the three 
vectors? 


87. v, = (1,0,1), v.=(-1,1,2), v3 = (0,1,4) 
58. v, = (1,0,1), v,=(—1,1,2), v3; = (0,1,3) 


59. Illustrate properties 1-10 of Theorem 4.2 for u = (2, — 1, 3, 6), 
v = (1,4, 0, 1), w = (3, 0, 2,0), c = 5, andd = —2. 
60. Illustrate properties 1-10 of Theorem 4.2 for u = (2, —1, 3), 
v = (3,4, 0), w = (7, 8, —4),c = 2,andd = —1. 
61. Complete the proof of Theorem 4.1. 
62. Prove each property of vector addition and scalar multiplication 
from Theorem 4.2. 
(a) Property 1: u + vis a vector in R”. 
(b) Property 2:u+v=vt+u 
(c) Property 3: (u + v) + w=u+ (v + w) 
(d) Property 4:u+0=u 
(e) Property 5: u + (—u) = 0 
(f) Property 6: cu is a vector in R”. 
(g) Property 7: clu + v) = cu + cv 
(h) Property 8: (c + dju = cu + du 
(i) Property 9: c(du) = (cd)u 
(3) Property 10: 1(u) = u 


In Exercises 63-67, complete the proofs of the remaining proper- 
ties of Theorem 4.3 by supplying the justification for each step. 
Use the properties of vector addition and scalar multiplication from 
Theorem 4.2. 


63. Property 2: The additive inverse of v is unique. That is, if 


v+u=0,thenu = —v. 
v+u=0 Given 
(-—v) +(v+u) =(-v) + 0 a. 
((-v) +v) +u=-—v b. 
0+u=-—v Cc: 
u+0=—v d. 
u=-v e. 


64. Property 3: Ov = 0 


Ov = (0 + O)v a. 

Ov = Ov + Ov b. 

Ov + (—Ov) = (Ov + Ov) + (—Ov) c. 
0 = Ov + (Ov + (—Ov)) d. 
0=0v+0 e. 

0 = Ov i, 

65. Property 4: c0 = 0 

c0 = c(0 + 0) a. 

c0 = c0+c0 b. 

c0 + (—c0) = (c0 + c0) + (—c0) c. 
0 = c0 + (cO + (—c0)) d. 
0=c0+0 e. 

0=c0 f. 


66. Property 5: If cv = 0, then c = 0 or v = 0. If c = 0, you are 
done. If c # 0, then c~! exists, and you have 


c lev) = c10 a. 
(c!e)v = 0 b. 
lv=0 Cc 
v=0. d. 

67. Property 6: —(—v) =v 
—(-v) + (-v) =Oandv+(—-v)=0 a 
(—v) + (-v) =v+ (-v) b. 
(-v) +(-v) +v=v+(-v)t+v c. 
(—v) + (~y) + v) =v + ((—v) + v) d 
(-v)+0=v+0 e 


—(-v) =v f. 
In Exercises 68 and 69, determine if the third column can be 
written as a linear combination of the first two columns. 


1 2 3 1 2 3 
68. | 7 8 9 69. | 7 8 9 
4 5 6 4 5 7 


70. Writing Let Ax = b be a system of m linear equations in n 
variables. Designate the columns of A as a,, a5,...,a,. If bisa 
linear combination of these n column vectors, explain why this 
implies that the linear system is consistent. Illustrate your 
answer with appropriate examples. What can you conclude 
about the linear system if b is not a linear combination of the 
columns of A? 


71. Writing How could you describe vector subtraction geomet- 
rically? What is the relationship between vector subtraction and 
the basic vector operations of addition and scalar multiplication? 


Definition of 
Vector Space 
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4.2 | Vector Spaces 


In Theorem 4.2, ten special properties of vector addition and scalar multiplication in R” 
were listed. Suitable definitions of addition and scalar multiplication reveal that many other 
mathematical quantities (such as matrices, polynomials, and functions) also share these ten 
properties. Any set that satisfies these properties (or axioms) is called a vector space, and 
the objects in the set are called vectors. 

It is important to realize that the next definition of vector space is precisely that—a 
definition. You do not need to prove anything because you are simply listing the axioms 
required of vector spaces. This type of definition is called an abstraction because you are 
abstracting a collection of properties from a particular setting R” to form the axioms for a 
more general setting. 


Let V be a set on which two operations (vector addition and scalar multiplication) are 
defined. If the listed axioms are satisfied for every u, v, and w in V and every scalar (real 
number) c and d, then V is called a vector space. 


Addition: 

1. u+visinV. Closure under addition 
2.utv=vt+u Commutative property 
3.u+(v+w)=(u+vytw Associative property 
4. Vhas a zero vector 0 such that for Additive identity 

every uinV,u+ 0=u. 
5. For every u in V, there is a vector Additive inverse 

in V denoted by —u such that 

u + (—u) = 0. 

Scalar Multiplication: 

6. cu is inV. Closure under scalar multiplication 
7. cu +v) =cu+cv Distributive property 
8. (c + du = cu+ du Distributive property 
9. c(du) = (cd)u Associative property 
10. 1(u) =u Scalar identity 


It is important to realize that a vector space consists of four entities: a set of vectors, a 
set of scalars, and two operations. When you refer to a vector space V, be sure all four 
entities are clearly stated or understood. Unless stated otherwise, assume that the set of 
scalars is the set of real numbers. 

The first two examples of vector spaces on the next page are not surprising. They are, in 
fact, the models used to form the ten vector space axioms. 
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EXAMPLE 1 


R? with the Standard Operations Is a Vector Space 


EXAMPLE 2 


The set of all ordered pairs of real numbers R* with the standard operations is a vector 
space. To verify this, look back at Theorem 4.1. Vectors in this space have the form 


v = (v,, v,). 


R” with the Standard Operations Is a Vector Space 


EXAMPLE 3 


The set of all ordered n-tuples of real numbers R” with the standard operations is a vector 
space. This is verified by Theorem 4.2. Vectors in this space are of the form 


V = (Vy, Vo) V39 2s os Vad 


7° n 


REMARK: From Example 2 you can conclude that R!, the set of real numbers (with the 
usual operations of addition and multiplication), is a vector space. 


The next three examples describe vector spaces in which the basic set V does not 


consist of ordered n-tuples. Each example describes the set V and defines the two vector 
operations. To show that the set is a vector space, you must verify all ten axioms. 


The Vector Space of All 2 x 3 Matrices 


SOLUTION 


EXAMPLE 4 


Show that the set of all 2 x 3 matrices with the operations of matrix addition and scalar 
multiplication is a vector space. 


If A and B are 2 x 3 matrices and c is a scalar, then A + B and cA are also 2 x 3 matrices. 
The set is, therefore, closed under matrix addition and scalar multiplication. Moreover, the 
other eight vector space axioms follow directly from Theorems 2.1 and 2.2 (see Section 2.2). 
You can conclude that the set is a vector space. Vectors in this space have the form 


a a a 
a-A-| 11 12 fy 


REMARK: In the same way you are able to show that the set of all 2 x 3 matrices 
is a vector space, you can show that the set of all m x n matrices, denoted by M,,,,,, is a 
vector space. 


m,n? 


The Vector Space of All Polynomials of Degree 2 or Less 


Let P, be the set of all polynomials of the form 


P(x) = ayx? + ayx + ap, 


SOLUTION 


EXAMPLE 5 
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where dp, a,, and a, are real numbers. The sum of two polynomials p(x) = a,x + 
a,x + dy and q(x) = b,x? + b,x + bo is defined in the usual way by 


P(x) + q(x) = (a, + b,)x? + (a, + b,)x + (dy + by), 
and the scalar multiple of p(x) by the scalar c is defined by 

cp(x) = ca,x? + ca,x + Cap. 
Show that P, is a vector space. 
Verification of each of the ten vector space axioms is a straightforward application of the 
properties of real numbers. For instance, because the set of real numbers is closed under 
addition, it follows that a, + b,, a, + b,, and dy + by are real numbers, and 

pla) + @@) = (a + 6) + (a; + Be > (a, + By) 


is in the set P, because it is a polynomial of degree 2 or less. P, is closed under 
addition. Similarly, you can use the fact that the set of real numbers is closed under multi- 
plication to show that P, is closed under scalar multiplication. To verify the commutative 
axiom of addition, write 
pa) + ae) = (ax + aja + a) > (be + bx + B,) 

= (a, + b,)x* + (a, + b,)x + (ay + Bo) 

= (by + a,)x* + (0, + a)x + (By + ay) 

= (bx + bye + B,) (ax + ax + a) 

= (x) + pa). 
Can you see where the commutative property of addition of real numbers was used? The 
zero vector in this space is the zero polynomial given by O(x) = Ox? + Ox + 0, for all x. 


Try verifying the other vector space axioms. You may then conclude that P, is a vector 
space. 


REMARK: Even though the zero polynomial O(x) = 0 has no degree, P, is often 
described as the set of all polynomials of degree 2 or Jess. 


P., is defined as the set of all polynomials of degree n or less (together with the zero 
polynomial). The procedure used to verify that P, is a vector space can be extended to show 
that P,,, with the usual operations of polynomial addition and scalar multiplication, is a 
vector space. 


The Vector Space of Continuous Functions (Calculus) 


Let C(—©o, 00) be the set of all real-valued continuous functions defined on the entire real 
line. This set consists of all polynomial functions and all other continuous functions on the 
entire real line. For instance, f(x) = sin x and g(x) = e* are members of this set. 
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y SOLUTION 


Figure 4.8 


Summary of Important 
Vector Spaces 


Addition is defined by 
(F + g)(x) = flx) + gt), 


as shown in Figure 4.8. Scalar multiplication is defined by 


(cf)(x) = cL fo]. 
Show that C(— 00, 00) is a vector space. 


To verify that the set C(— 00, 00) is closed under addition and scalar multiplication, you can 
use a result from calculus—the sum of two continuous functions is continuous and the prod- 
uct of a scalar and a continuous function is continuous. To verify that the set C(— 00, oo) has 
an additive identity, consider the function fp that has a value of zero for all x, meaning that 


fo(x) = 0, where x is any real number. 


This function is continuous on the entire real line (its graph is simply the line y = 0), which 
means that it is in the set C(— 00, co). Moreover, if fis any other function that is continu- 
ous on the entire real line, then 


(f + fo)(x) = f(x) + folx) = fx) + 0 = fQ). 


This shows that fy is the additive identity in C(—00, 00). The verification of the other 
vector space axioms is left to you. 


For convenience, the summary below lists some important vector spaces frequently 
referenced in the remainder of this text. The operations are the standard operations in each 
case. 


R = set of all real numbers 
R? = set of all ordered pairs 
R? = set of all ordered triples 
R" = set of all n-tuples 
C(— 00, co) = set of all continuous functions defined on the real number line 
Cla, b] = set of all continuous functions defined on a closed interval [a, b] 

P = set of all polynomials 
P., = set of all polynomials of degree < n 

Mn = set of all m x n matrices 

M,,,, = Set of all n x n square matrices 


You have seen the versatility of the concept of a vector space. For instance, a vector can 
be a real number, an n-tuple, a matrix, a polynomial, a continuous function, and so on. But 
what is the purpose of this abstraction, and why bother to define it? There are several 
reasons, but the most important reason applies to efficiency. This abstraction turns out to be 
mathematically efficient because general results that apply to all vector spaces can now be 
derived. Once a theorem has been proved for an abstract vector space, you need not give 
separate proofs for m-tuples, matrices, and polynomials. You can simply point out that the 
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theorem is true for any vector space, regardless of the particular form the vectors happen to 
take. This process is illustrated in Theorem 4.4. 


THEOREM 4.4 — Let v be any element of a vector space V, and let c be any scalar. Then the following prop- 
Properties of erties are true. 


ene gs 1. Ov=0 2. 0=0 
Scalar Multiplication 
P 3. Ifcv = 0, enc = 0 orv=0. 4. (-1)v = -v 


PROOF To prove these properties, you are restricted to using the ten vector space axioms. For 
instance, to prove the second property, note from axiom 4 that 0 = 0 + 0. This allows you 
to write the steps below. 


c0 = c(0 + 0) Additive identity 

c0 = c0 + c0 Left distributive property 
c0 + (—c0) = (c0 + c0) + (—c0) Add —c0 to both sides. 
c0 + (—c0) = c0 + [c0 + (—c0)] Associative property 

0=c0+0 Additive inverse 

0 = 0 Additive identity 


To prove the third property, suppose that cv = 0. To show that this implies either c = 0 or 
v = 0, assume that c # 0. (If c = 0, you have nothing more to prove.) Now, because 
c # 0, you can use the reciprocal 1/c to show that v = 0, as follows. 


v=iv=(2)ov (cx) = ~(0) = 0 


Note that the last step uses Property 2 (the one you just proved). The proofs of the first and 
fourth properties are left as exercises. (See Exercises 38 and 39.) 


The remaining examples in this section describe some sets (with operations) that do 
not form vector spaces. To show that a set is not a vector space, you need only find one 
axiom that is not satisfied. For example, if you can find two members of V that do not 
commute (u + v # v + u), then regardless of how many other members of V do commute 
and how many of the other ten axioms are satisfied, you can still conclude that V is not a 
vector space. 


EXAMPLE 6| The Set of Integers Is Not a Vector Space 


The set of all integers (with the standard operations) does not form a vector space because 
it is not closed under scalar multiplication. For example, 


Scalar Integer Noninteger 
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EXAMPLE 7 


REMARK: In Example 6, notice that a single failure of one of the ten vector space axioms 
suffices to show that a set is not a vector space. 


In Example 4 it was shown that the set of all polynomials of degree 2 or less forms a 


vector space. You will now see that the set of all polynomials whose degree is exactly 
2 does not form a vector space. 


The Set of Second-Degree Polynomials Is Not a Vector Space 


EXAMPLE 8 


The set of all second-degree polynomials is not a vector space because it is not closed under 
addition. To see this, consider the second-degree polynomials 

p(x) = x? and q(x) = —x? +x41, 
whose sum is the first-degree polynomial 


D(x) + q(x) =x + 1. 


The sets in Examples 6 and 7 are not vector spaces because they fail one or both closure 
axioms. In the next example you will look at a set that passes both tests for closure but still 
fails to be a vector space. 


A Set That Is Not a Vector Space 


SOLUTION 


Let V = R’, the set of all ordered pairs of real numbers, with the standard operation of 
addition and the nonstandard definition of scalar multiplication listed below. 


c(x,, Xp) = (cx, 0) 
Show that V is not a vector space. 


In this example, the operation of scalar multiplication is not the standard one. For instance, 
the product of the scalar 2 and the ordered pair (3, 4) does not equal (6, 8). Instead, the 
second component of the product is 0, 


2(3, 4) = (2+ 3,0) = (6,0). 


This example is interesting because it actually satisfies the first nine axioms of the defini- 
tion of a vector space (try showing this). The tenth axiom is where you get into trouble. 
In attempting to verify that axiom, the nonstandard definition of scalar multiplication 
gives you 


101, 1) = (0,0) # C, 1). 


The tenth axiom is not verified and the set (together with the two operations) is not a vector 
space. 
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Do not be confused by the notation used for scalar multiplication in Example 8. In writing 


(xy, %) = (cx, 0), 


the scalar multiple of (x,, x) by c is defined to be (cx,, 0). As it turns out, this nonstandard 
definition fails to satisfy the tenth vector space axiom. 


SaeNte aye Exercises 


In Exercises 1—6, describe the zero vector (the additive identity) of 
the vector space. 

1. Rt 2. C(—o0, 00) 3. M,, 

4. Mi, 5. P, 6. M,>5 
In Exercises 7—12, describe the additive inverse of a vector in the 
vector space. 

7. Rt 8. C(—00, o0) 9. M33 
10. M, 4 11. P,; 12. M,, 
In Exercises 13-28, determine whether the set, together with the 
indicated operations, is a vector space. If it is not, identify at least 
one of the ten vector space axioms that fails. 
13. M,,., with the standard operations 
14. M,, with the standard operations 


15. The set of all third-degree polynomials with the standard 
operations 


16. The set of all fifth-degree polynomials with the standard 
operations 


17. The set of all first-degree polynomial functions ax + b, 
a # 0, whose graphs pass through the origin with the standard 
operations 


18. The set of all quadratic functions whose graphs pass through 
the origin with the standard operations 


19. The set {(x, y): x = 0, y is a real number} with the standard 
operations in R? 

20. The set {(x, y): x = 0, y = O} with the standard operations 
in R? 

21. The set {(x, x): x is a real number} with the standard operations 

22. The set {(x, bx): x is a real number} with the standard 


operations 


23. The set of all 2 x 2 matrices of the form 


Cal 


with the standard operations 


24. 


25. 


26. 


27. 


28. 


29. 


30. 


The set of all 2 x 2 matrices of the form 


at 
c 1 
with the standard operations 


The set of all 2 x 2 singular matrices with the standard 
operations 

The set of all 2 x 2 nonsingular matrices with the standard 
operations 

The set of all 2 x 2 diagonal matrices with the standard 
operations 

C[O, 1], the set of all continuous functions defined on the 
interval [0, 1], with the standard operations 

Rather than use the standard definitions of addition and scalar 


multiplication in R*, suppose these two operations are defined 
as follows. 


(a) (x,y) (x5, 9) = (x, + X5,y, 4 y) 
e(x, y) = (cx, y) 

(b) (x1, 91) + G2, ¥2) = (%, 0) 
c(x, y) = (cx, cy) 

(C) (91) + Ga, Yo) = Oy + Xs, + yo) 


cx, y) = (Vex, Vey) 


With these new definitions, is R* a vector space? Justify your 
answers. 

Rather than use the standard definitions of addition and scalar 
multiplication in R?, suppose these two operations are defined 
as follows. 


(a) 9%) + Ga ¥n %) = Oy + XY, + Ya Z +B) 
c(x, y, z) = (ex, cy, 0) 
(b) (x1, 915 21) + Ora» Yo» Za) = (0, 0, 0) 
c(x, y, z) = (ex, cy, cz) 
(C) (1, Y1s 21) + Oa, Yo» 2) 
= (x, r X, 4 


l,y, yo 7 
c(x, y, z) = (ex, cy, cz) 
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31. 


32. 


33. 


34. 
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(d) (1, Y1s 21) + (ps Yos 20) 
= (x, 


a(x, y, 2) = (cx + ¢ 


% + 1y,ty,+1,z,+54+1) 
lez +e -1) 


lreoyt+e 
With these new definitions, is R? a vector space? Justify your 
answers. 

Prove in full detail that M,,, with the standard operations, is a 
vector space. 

Prove in full detail, with the standard operations in R?, that the 
set {(x, 2x): x is a real number} is a vector space. 

Determine whether the set R*, with the operations 

(x1, ¥1) + Ora, Yo) = Oro, Ya) 

and 

c(%, 91) = (cx, ey), 

is a vector space. If it is, verify each vector space axiom; if not, 
state all vector space axioms that fail. 

Let V be the set of all positive real numbers. Determine whether 
V is a vector space with the operations below. 

x+y=xy Addition 
Cx xP Scalar multiplication 


If it is, verify each vector space axiom; if not, state all vector 
space axioms that fail. 


True or False? In Exercises 35 and 36, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, 
provide an example that shows the statement is not true in all cases 
or cite an appropriate statement from the text. 


35. 


36. 


37. 


38. 
39. 
40. 
41. 


(a) A vector space consists of four entities: a set of vectors, a set 
of scalars, and two operations. 


(b) The set of all integers with the standard operations is a 
vector space. 

(c) The set of all pairs of real numbers of the form (x, y), where 
y = 0, with the standard operations on R? is a vector space. 

(a) To show that a set is not a vector space, it is sufficient to 
show that just one axiom is not satisfied. 

(b) The set of all first-degree polynomials with the standard 
operations is a vector space. 

(c) The set of all pairs of real numbers of the form (0, y), with 
the standard operations on R?, is a vector space. 

Complete the proof of the cancellation property of vector 

addition by supplying the justification for each step. 

Prove that if u, v, and w are vectors in a vector space V such 
thatu + w = v-+ w, then u = v. 


u+w=vtw Given 

(u + w) + (—w) = (v+ w) + (-w) 

u + (w + (—w)) = v + (w + (-w)) 
u+0=v+0 


u-v 


ao FP 


Prove Property 1 of Theorem 4.4. 
Prove Property 4 of Theorem 4.4. 
Prove that in a given vector space V, the zero vector is unique. 


Prove that in a given vector space V, the additive inverse of a 
vector is unique. 


Subspaces of Vector Spaces 


In most important applications in linear algebra, vector spaces occur as subspaces of larger 
spaces. For instance, you will see that the solution set of a homogeneous system of linear 
equations in n variables is a subspace of R”. (See Theorem 4.16.) 

A subset of a vector space is a subspace if it is a vector space (with the same operations), 
as stated in the next definition. 


Definition of Subspace 
of a Vector Space 


A nonempty subset W of a vector space V is called a subspace of V if W is a vector space 
under the operations of addition and scalar multiplication defined in V. 


REMARK: Note that if W is a subspace of V, it must be closed under the operations 


inherited from V. 


EXAMPLE 1 
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A Subspace of R? 


SOLUTION 


(x1, 0, x3) 


x 


Figure 4.9 


THEOREM 4.5 
Test for a Subspace 


PROOF 


Show that the set W = {(x,, 0, x3): x, and x, are real numbers} is a subspace of R? with the 
standard operations. 


The set W is nonempty because it contains the zero vector (0, 0, 0). 

Graphically, the set W can be interpreted as simply the xz-plane, as shown in Figure 4.9. 
The set W is closed under addition because the sum of any two vectors in the xz-plane must 
also lie in the xz-plane. That is, if (x,,0,x;) and (y,,0,y3) are in W, then their sum 
(x, + y,,0,x3 + y3) is also in W (because the second component is zero). Similarly, to see 
that W is closed under scalar multiplication, let (x, 0, x) be in W and let c be a scalar. Then 
c(x,, 0, x3) = (cx,, 0, cx;) has zero as its second component and must be in W. The other 
eight vector space axioms can be verified as well, and these verifications are left to you. 


To establish that a set W is a vector space, you must verify all ten vector space proper- 
ties. If W is a subset of a larger vector space V (and the operations defined on W are the 
same as those defined on V), however, then most of the ten properties are inherited from 
the larger space and need no verification. The next theorem tells us it is sufficient to test for 
closure in order to establish that a nonempty subset of a vector space is a subspace. 


The proof of this theorem in one direction is straightforward. That is, if W is a subspace of 
V, then W is a vector space and must be closed under addition and scalar multiplication. 

To prove the theorem in the other direction, assume that W is closed under addition and 
scalar multiplication. Note that if u,v, and w are in W, then they are also in V. 
Consequently, vector space axioms 2, 3, 7, 8, 9, and 10 are satisfied automatically. Because 
W is closed under addition and scalar multiplication, it follows that for any v in W and 
scalar c = 0, 


cv=0 
and 
(-lv=-v 


both lie in W, which satisfies axioms 4 and 5. 


REMARK: Note that if Wis a subspace of a vector space V, then both W and V must have 
the same zero vector 0. (See Exercise 43.) 
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EXAMPLE 2 


Because a subspace of a vector space is a vector space, it must contain the zero vector. 
In fact, the simplest subspace of a vector space is the one consisting of only the zero vector, 


W = {0}. 


This subspace is called the zero subspace. Another obvious subspace of V is V itself. Every 
vector space contains these two trivial subspaces, and subspaces other than these two are 
called proper (or nontrivial) subspaces. 


The Subspace of M, , 


SOLUTION 


EXAMPLE 3 


Let W be the set of all 2 x 2 symmetric matrices. Show that W is a subspace of the vector 
space M, 5, with the standard operations of matrix addition and scalar multiplication. 
Recall that a matrix is called symmetric if it is equal to its own transpose. Because M, , is a 
vector space, you only need to show that W (a subset of M, ,) satisfies the conditions of 
Theorem 4.5. Begin by observing that W is nonempty. W is closed under addition because 
A, = Aj and A, = A, which implies that 

(A, + Aj)? = AT + AD =A, + A. 
So, if A, and A, are symmetric matrices of order 2, then so is A, + A,. Similarly, W is 


closed under scalar multiplication because A = A’ implies that (cA)’ = cA? = cA. If A is 
a symmetric matrix of order 2, then so is cA. 


The result of Example 2 can be generalized. That is, for any positive integer 7, the set 
of symmetric matrices of order n is a subspace of the vector space M,, ,, with the standard 


AN 
operations. The next example describes a subset of M,,,, that is not a subspace. 


An 


The Set of Singular Matrices Is Not a Subspace of M,,_, 


SOLUTION 


Let W be the set of singular matrices of order 2. Show that W is not a subspace of M, , with 
the standard operations. 


By Theorem 4.5, you can show that a subset W is not a subspace by showing that W is empty, 
W is not closed under addition, or W is not closed under scalar multiplication. For this 
particular set, Wis nonempty and closed under scalar multiplication, but it is not closed under 
addition. To see this, let A and B be 


1 
A= a and B= I Hl 
0 0 0 1 


Then A and B are both singular (noninvertible), but their sum 
1 0 
A+B= 
0 1 


is nonsingular (invertible). So W is not closed under addition, and by Theorem 4.5 you can 
conclude that it is not a subspace of M, ,. 


EXAMPLE 4 
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The Set of First Quadrant Vectors Is Not a Subspace of R? 


SOLUTION 


EXAMPLE 5 


Show that W = {(x,,x,):x, = Oandx, = 0}, with the standard operations, is not a 
subspace of R?. 


This set is nonempty and closed under addition. It is not, however, closed under scalar 
multiplication. To see this, note that (1, 1) is in W, but the scalar multiple 


(00,1) St=1=1) 


is not in W. So W is not a subspace of R?. 


You will often encounter sequences of subspaces nested within each other. For instance, 
consider the vector spaces 


Po PysPoPoe+ +, and P,, 


where P, is the set of all polynomials of degree less than or equal to k, with the standard 
operations. It is easy to show that if j < k, then P; is a subspace of P,. You can write 
Py) CP, CP, CP,C-.--+C P,. Another nesting of subspaces is described in Example 5. 


Subspaces of Functions (Calculus) 


SOLUTION 


Let W, be the vector space of all functions defined on [0, 1], and let W,, W,, W3, and W, 
be defined as follows. 


= 
| 


= set of all polynomial functions defined on the interval [0, 1] 
W, = set of all functions that are differentiable on [0, 1] 
= set of all functions that are continuous on [0, 1] 


a3 
| 


set of all functions that are integrable on [0, 1] 
Show that W, C W, C W; C W, C W, and that W; is a subspace of W; fori < j. 


From calculus you know that every polynomial function is differentiable on [0, 1]. So, 
W, C W,. Moreover, W, C W, because every differentiable function is continuous, W; C W, 
because every continuous function is integrable, and W, C W, because every integrable 
function is a function. Resulting from the previous remarks, you have W, C W, C W;C 
W,C Ws, as shown in Figure 4.10. The verification that W; is a subspace of W; for i < j is 
left to you. 


Figure 4.10 
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THEOREM 4.6 
The Intersection of Two 
Subspaces Is a Subspace 


PROOF 


EXAMPLE 6 


Note in Example 5 that if U, V, and W are vector spaces such that W is a subspace of V 
and V is a subspace of U, then W is also a subspace of U. This special case of the next 
theorem tells us that the intersection of two subspaces is a subspace, as shown in Figure 
4.11. 


Figure 4.11 The intersection of two subspaces is a subspace. 


If V and W are both subspaces of a vector space U, then the intersection of V and W 
(denoted by V M W) is also a subspace of U. 


Because V and W are both subspaces of U, you know that both contain the zero vector, which 
means that VM W is nonempty. To show that VN W is closed under addition, let v, and v, 
be any two vectors in VM W. Then, because V and W are both subspaces of U, you know that 
both are closed under addition. Because v, and v, are both in V, their sum v, + v, must be 
in V. Similarly, v, + v, is in W because v, and vy, are both in W. But this implies that v, + v, 
is in VN W, and it follows that VM W is closed under addition. It is left to you to show (by 
a similar argument) that VM W is closed under scalar multiplication. (See Exercise 48.) 


REMARK: Theorem 4.6 states that the intersection of two subspaces is a subspace. In 
Exercise 44 you are asked to show that the union of two subspaces is not (in general) a 
subspace. 


Subspace of R” 


R” is a convenient source for examples of vector spaces, and the remainder of this section 
is devoted to looking at subspaces of R”. 


Determining Subspaces of R? 


SOLUTION 


Which of these two subsets is a subspace of R*? 
(a) The set of points on the line x + 2y = 0 
(b) The set of points on the line x + 2y = 1 


(a) Solving for x, you can see that a point in R? is on the line x + 2y = 0 if and only if it 
has the form (—2t, t), where ¢ is any real number. (See Figure 4.12.) 


Figure 4.12 


EXAMPLE 7 
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To show that this set is closed under addition, let 
v, = (—2t,,t,) and v, = (—2t, 4) 
be any two points on the line. Then you have 
v, + v, = (—24, t,) + (—2, tb) 
=(=20, + 4), +t) 
= (—24, 4), 


where ¢; = t, + ft. Vv, + V, lies on the line, and the set is closed under addition. In a 
similar way, you can show that the set is closed under scalar multiplication. So, this set 
is a subspace of R?. 


(b) This subset of R? is not a subspace of R* because every subspace must contain the zero 
vector, and the zero vector (0, 0) is not on the line. (See Figure 4.12.) 


Of the two lines in Example 6, the one that is a subspace of R? is the one that passes 
through the origin. This is characteristic of subspaces of R?. That is, if W is a subset of R?, 
then it is a subspace if and only if one of the three possibilities listed below is true. 

1. Wconsists of the single point (0, 0). 
2. W consists of all points on a /ine that pass through the origin. 
3. W consists of all of R?. 


These three possibilities are shown graphically in Figure 4.13. 


BY y 

A A 

2+ 2+ 

1+ at 

t+} + —> x 1 i” ~ 
3-21 [I 2 20 i 2 

a+ aye 

ee yale 

W={(0, 0)} W =all points on a line W=R? 
passing through the origin 
Figure 4.13 


A Subset of R? That Is Not a Subspace 


SOLUTION 


Show that the subset of R? consisting of all points on the unit circle x7 + y? = 1 is nota 
subspace. 


This subset of R? is not a subspace because the points (1, 0) and (0, 1) are in the subset, but 
their sum (1, 1) is not. (See Figure 4.14.) So, this subset is not closed under addition. 
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EXAMPLE 8 


The unit circle is 
not a subspace 
O,-1) of R2. 


Figure 4.14 


REMARK: Another way you can tell that the subset shown in Figure 4.14 is not a 
subspace of R? is by noting that it does not contain the zero vector (the origin). 


Determining Subspaces of R? 


SOLUTION 


Which of the subsets below is a subspace of R*? 
(a) W = {(x,, X, 1): x, and x, are real numbers} 
(b) W = {(x,,.x, + x3, x3): x, and x, are real numbers} 


(a) Because 0 = (0, 0, 0) is not in W, you know that W is not a subspace of R°. 

(b) This set is nonempty because it contains the zero vector (0,0,0). Let 
v = (v,, v, + v3, v3) and u = (u,, u, + U3, U3) be two vectors in W, and let c be any 
real number. Show that W is closed under addition, as follows. 

vtu=(y, + u,v, + v3 + uy, + U3, V3 + U3) 
= {vy + ay Oy + uw) + Oy + we), + ) 
= (x1, x, + x3, x3) 
where x, = v, + u, and x, = v, + uz. V + wis in W because it is of the proper form. 
Similarly, W is closed under scalar multiplication because 
cv = (cv, c(v, + v3), ev3) 
= (cv, cv, + CV3, CV3) 
= (x, X, + X3, 3) 


where x, = cv, and x; = cv3, which means that cv is in W. Finally, because W is closed 
under addition and scalar multiplication, you can conclude that it is a subspace of R?. 


In Example 8, note that the graph of each subset is a plane in R?. But the only subset 
that is a subspace is the one represented by a plane that passes through the origin. (See 
Figure 4.15.) 
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N 
q 


The origin does The origin lies 
not lie in the in the plane. 
plane. 


Figure 4.15 


In general, you can show that a subset W of R? is a subspace of R? (with the standard 
operations) if and only if it has one of the forms listed below. 


1. Wconsists of the single point (0, 0, 0). 

2. W consists of all points on a /ine that pass through the origin. 
3. W consists of all points in a plane that pass through the origin. 
4. W consists of all of R?. 


SAN ee Exercises 


In Exercises 1—6, verify that W is a subspace of V. In each case, 
assume that V has the standard operations. 


L. W = {(%, X5, 5, 0): x), x5, and x, are real numbers} 
V=R* 

2. W = {(x, y, 2x — 3y): x and y are real numbers} 
V=R 

3. W is the set of all 2 x 2 matrices of the form 


sof 


V=M), 
4. Wis the set of all 3 x 2 matrices of the form 
a b 
at+b Oj}. 
0 éc 


V= M3, 
5. Calculus W is the set of all functions that are continuous on 


[0, 1]. V is the set of all functions that are integrable on [0, 1]. 


6. Calculus Wis the set of all functions that are differentiable on 
[0, 1]. Vis the set of all functions that are continuous on [0, 1]. 


In Exercises 7-18, W is not a subspace of the vector space. Verify 
this by giving a specific example that violates the test for a vector 
subspace (Theorem 4.5). 


7. Wis the set of all vectors in R? whose third component is — 1. 
8. W is the set of all vectors in R? whose second component is 1. 


9. W is the set of all vectors in R* whose components are 
rational numbers. 


10. Wis the set of all vectors in R? whose components are integers. 
11. W is the set of all nonnegative functions in C(—0e, 00). 
12. Wis the set of all linear functions ax + b, a # 0, in 
C(— ©, 00). 
13. W is the set of all vectors in R*? whose components are 
nonnegative. 


14. W is the set of all vectors in R* whose components are 
Pythagorean triples. 


15. W is the set of all matrices in M,,,, with zero determinants. 


16. W is the set of all matrices in M, such that A? = A. 


AN 
17. Wis the set of all vectors in R* whose second component is the 
cube of the first. 
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18. Wis the set of all vectors in R* whose second component is the 
square of the first. 


In Exercises 19-24, determine if the subset of C(— 00, 00) is a sub- 
space of C(— 00, 00). 

19. The set of all nonnegative functions: f(x) = 0 

20. The set of all even functions: f(—x) = f(x) 

21. The set of all odd functions: f(—x) = —f(x) 

22. The set of all constant functions: f(x) = c 

23. The set of all functions such that f(0) = 0 

24. The set of all functions such that f(0) = 1 


In Exercises 25—30, determine if the subset of M,,,, 
M_,, with the standard operations. 


nn 


is a subspace of 


25. The set of all n x n upper triangular matrices 
26. The set of all n x n matrices with integer entries 


27. The set of all m x n matrices A that commute with a given 
matrix B 


28. The set of all n x n singular matrices 

29. The set of all n x n invertible matrices 

30. The set of all n x n matrices whose entries add up to zero 

In Exercises 31-36, determine whether the set W is a subspace of 
R? with the standard operations. Justify your answer. 

31. W = {(x,, 0, x3): x, and x, are real numbers} 

32. W = {(x,, x», 4): x, and x, are real numbers} 

33. W = {(a, b, a + 2b): a and b are real numbers} 

34. W = {(s, s — ¢, 2): s and ¢ are real numbers} 

35. W = {(x,, x), x)X>): x; and x, are real numbers} 


36. W = {(x, I/x,, x5): x, and x, are real numbers, x, # 0} 


True or False? In Exercises 37 and 38, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, pro- 
vide an example that shows the statement is not true in all cases or 
cite an appropriate statement from the text. 


37. (a) Every vector space V contains at least one subspace that is 
the zero subspace. 


(b) If V and W are both subspaces of a vector space U, then the 
intersection of V and W is also a subspace. 


(c) If U, V, and W are vector spaces such that W is a subspace 
of V and U is a subspace of V, then W = U. 


38. (a) Every vector space V contains two proper subspaces that 
are the zero subspace and itself. 
(b) If W is a subspace of R?, then W must contain the vector 
(0, 0). 


(c) If W and U are subspaces of a vector space V, then the 
union of W and U is a subspace of V. 


39. Guided Proof Prove that a nonempty set W is a subspace of a 
vector space V if and only if ax + by is an element of W for all 
scalars a and b and all vectors x and y in W. 

Getting Started: In one direction, assume W is a subspace, 
and show by using closure axioms that ax + by lies in W. In the 
other direction, assume ax + by is an element of W for all real 
numbers a and b and elements x and y in W, and verify that W 
is closed under addition and scalar multiplication. 

(i) If W is a subspace of V, then use scalar multiplication 
closure to show that ax and by are in W. Now use 
additive closure to get the desired result. 

(ii) Conversely, assume ax + by is in W. By cleverly 
assigning specific values to a and b, show that W is 
closed under addition and scalar multiplication. 

40. Let x, y, and z be vectors in a vector space V. Show that the set 
of all linear combinations of x, y, and z 


W = {ax + by + cz: a, b, and c are scalars} 
is a subspace of V. This subspace is called the span of {x, y, z}. 
41. Let A be a fixed 2 x 3 matrix. Prove that the set 


y-frema-[!] 


is not a subspace of R?. 

42. Let A be a fixed m x n matrix. Prove that the set 
W = {x € R": Ax = 0} 
is a subspace of R”. 


43. Let W be a subspace of the vector space V. Prove that the zero 
vector in V is also the zero vector in W. 


44. Give an example showing that the union of two subspaces of a 
vector space V is not necessarily a subspace of V. 


45. Let A be a fixed 2 x 2 matrix. Prove that the set 
W = {X: XA = AX} 


is a subspace of M, ,. 


46. Calculus Determine whether the set 


S= {re c[0, 1 | 400 dx = of 


is a subspace of C[0, 1]. Prove your answer. 


47. Let V and W be two subspaces of a vector space U. Prove that 


the set 


V+ W={u:u=v-+ w, where v € Vand w € WI 
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48. Complete the proof of Theorem 4.6 by showing that the inter- 
section of two subspaces of a vector space is closed under scalar 
multiplication. 


is a subspace of U. Describe V + W if V and W are the 


subspaces of U = R?: 


V = {(x, 0) : x is a real number} and W = {(0, y) : y is a real 


number}. 


Definition of Linear 
Combination of Vectors 


EXAMPLE 1 


4.4 


Spanning Sets and Linear Independence 


This section begins to develop procedures for representing each vector in a vector space as 
a linear combination of a select number of vectors in the space. 


A vector v in a vector space V is called a linear combination of the vectors 


u,,U,,. . ., u, in Vif v can be written in the form 
Vi > CU ae CoUn dt 2 ae GU, 
where c,,C>,. . ., ¢, are scalars. 


Often, one or more of the vectors in a set can be written as linear combinations of other 
vectors in the set. Examples 1, 2, and 3 illustrate this possibility. 


Examples of Linear Combinations 


(a) For the set of vectors in R°, 


Wy 


5 = {(1,3.1),0,1,2).(1,0.-5)) 
v, is a linear combination of v, and v3 because 
v, = 3v, + v3 = 3(0, 1, 2) + (1, 0, —5) 
= (1,3, 1). 
(b) For the set of vectors in M, ,, 


v v> V3 Vy 
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vy, is a linear combination of v,, v3, and v, because 


V, =v, + 2v3, — Vy 
k | ie | ie | 
1 0 1 2 1 3 
_ I; | 
2 1y 


In Example | it was easy to verify that one of the vectors in the set S was a linear com- 
bination of the other vectors because you were provided with the appropriate coefficients to 
form the linear combination. In the next example, a procedure for finding the coefficients 
is demonstrated. 


EXAMPLE 2| Finding a Linear Combination 


Write the vector w = (1, 1, 1) as a linear combination of vectors in the set S. 


Vv, V> v3 


S = {(1,2, 3), (0, 1,2), {—1, 0, 1} 


SOLUTION You need to find scalars c,, c,, and c, such that 


G11) =<¢0,2,3) + 60; 1,2): + 6-10, 1) 
(cy — C3, 2c; + 5, 3c, + 2c, + €3). 


Equating corresponding components yields the system of linear equations below. 


Cy —-c=1 
2¢, + Cy =1 
3c, + 2c, +c, = 1 


Using Gauss-Jordan elimination, you can show that this system has an infinite number of 
solutions, each of the form 


cq =H=1t+t, 63 = 1 28, Cz =H. 


To obtain one solution, you could let f = 1. Then c; = 1, c) = —3, and c, = 2, and you 
have 


w = 2v, — 3v, + V3. 


Other choices for t would yield other ways to write w as a linear combination of v,, V>, 
and v3. 


EXAMPLE 3 
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Finding a Linear Combination 


SOLUTION 


Definition of Spanning Set 
of a Vector Space 


EXAMPLE 4 


If possible, write the vector w = (1, —2, 2) as a linear combination of vectors in the set S 
from Example 2. 


Following the procedure from Example 2 results in the system 
cy =i, = 1 
2¢, + Cy = 2 
3c, + 2c, +¢,= 2. 
The augmented matrix of this system row reduces to 
1 0 -i1 0 
0 1 2 0}. 
0 oO O 1 
From the third row you can conclude that the system of equations is inconsistent, and that 


means that there is no solution. Consequently, w cannot be written as a linear combination 
of v,, V5, and v3. 


Spanning Sets 


If every vector in a vector space can be written as a linear combination of vectors in a set 
S, then S is called a spanning set of the vector space. 


Examples of Spanning Sets 


(a) The set S = {(1, 0, 0), (0, 1, 0), (0, 0, 1)} spans R? because any vector u = (u,, Uy, U3) 
in R? can be written as 


u = u,(1, 0,0) + u,(0, 1,0) + u,(0, 0, 1) = (u,, u5, U3). 


(b) The set S = {1, x, x?} spans P, because any polynomial function p(x) = a + bx + cx? 
in P, can be written as 


p(x) = a(1) + d(x) + c(x?) 
=a+ bx + cx’. 


210 


Chapter 4 Vector Spaces 


EXAMPLE 5 


The spanning sets in Example 4 are called the standard spanning sets of R? and P,, 
respectively. (You will learn more about standard spanning sets in the next section.) In the 
next example you will look at a nonstandard spanning set of R°?. 


A Spanning Set of R? 


SOLUTION 


EXAMPLE 6 


Show that the set § = {(1, 2, 3), (0, 1, 2), (—2, 0, 1)} spans R?. 
Let u = (uj, uy, u;) be any vector in R. You need to find scalars c,, c>, and c; such that 
(uy, Uy, U3) = c, (1, 2, 3) + c,(0, 1, 2) + c3(—2, 0, 1) 
= (c, = 263; 2C) FC, 3C) #26, + x). 
This vector equation produces the system 
Cy — 2c, = uy 
20; C5 = ly 
3c, + 2c, + cz = Uy. 
The coefficient matrix for this system has a nonzero determinant, and it follows from the 
list of equivalent conditions given in Section 3.3 that the system has a unique solution. So, 


any vector in R? can be written as a linear combination of the vectors in S, and you can 
conclude that the set S spans R?. 


A Set That Does Not Span R? 


From Example 3 you know that the set 
S = {(, 2, 3), (0, 1, 2), (—1, 0, 1)} 


does not span R? because w = (1, —2, 2) is in R? and cannot be expressed as a linear com- 
bination of the vectors in S. 


Comparing the sets of vectors in Examples 5 and 6, note that the sets are the same except 
for a seemingly insignificant difference in the third vector. 
Ss, = {(1, 2, 3), (0, 1, 2), (—2, 0, 1)} Example 5 
S, = {(1, 2, 3), (0, 1, 2), (—1, 0, 1)} Example 6 
The difference, however, is significant, because the set S, spans R? whereas the set S, does 


not. The reason for this difference can be seen in Figure 4.16. The vectors in S, lie in a 
common plane; the vectors in S, do not. 


Definition of the 
Span of a Set 


THEOREM 4.7 
Span(S) Is a Subspace of V 


PROOF 
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S;={(., 2, 3), (0, 1,2),(-2,0,D} $= {C, 2, 3), (0, 1, 2), (-1, 0, 1D} 


The vectors in S; do not lie The vectors in $5 lie ina 
in a common plane. common plane. 
Figure 4.16 


Although the set S, does not span all of R?, it does span a subspace of R?—namely, the 
plane in which the three vectors of S, lie. This subspace is called the span of S,, as 
indicated in the next definition. 


If S = {v,, V5,. . ., V,} is a set of vectors in a vector space V, then the span of S is the 
set of all linear combinations of the vectors in S, 


span(S)i= eV, + GV te Vpn cy, yc, are Teal numbers). 


The span of S is denoted by span(S) or span{v,, V>,. . ., V,}. If span(S) = V, it is said 
that V is spanned by {v,, v5,. . ., V,}, or that S spans V. 


The theorem below tells you that the span of any finite nonempty subset of a vector space 
V is a subspace of V. 


If S = {v,, V>,. . ., V,} is a set of vectors in a vector space V, then span(S) is a subspace 
of V. Moreover, span(S) is the smallest subspace of V that contains S, in the sense that 
every other subspace of V that contains S must contain span(S). 


To show that span(S), the set of all linear combinations of v,, V,,. . ., V,, is a subspace of 
V, show that it is closed under addition and scalar multiplication. Consider any two vectors 
u and v in span(S), 

U = CV, + OnVy To + OV, 

v=dyv,+dav,+:-:-:+d\y,, 
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where c,,C>,. . .,c, and d,,d,,. . .,d, are scalars. Then 
utv=( +d)y + (6.4 ad) eos + + ey; 
and 
cu = (cc,)v, + (cc3)v, ++ + + + (ce,)vy, 


which means that u + v and cu are also in span(S) because they can be written as linear 
combinations of vectors in S. So, span(S) is a subspace of V. It is left to you to prove that 
span(S) is the smallest subspace of V that contains S. (See Exercise 50.) 


Linear Dependence and Linear Independence 


For a given set of vectors S = {v,, V>,. . ., V,} in a vector space V, the vector equation 
CV, + OV, +--+ +eVv,=90 

always has the trivial solution 
c,; = 0,c, =0,...,c¢,= 0. 


Often, however, there are also nontrivial solutions. For instance, in Example 1(a) you saw 
that in the set 


vy, Vv, Vv; 
S = {(1, 3, 1), (0, 1, 2), (1, 0, —5)}, 

the vector v, can be written as a linear combination of the other two as follows. 
v, = 3v,+ v; 

The vector equation 
CV, + CoV> + 63V3 = 0 

has a nontrivial solution in which the coefficients are not all zero: 
¢ =1, ¢; = —3, c= 1. 


This characteristic is described by saying that the set S is linearly dependent. Had the only 
solution been the trivial one (c; = c, = c, = 0), then the set S would have been linearly 
independent. This notion is essential to the study of linear algebra, and is formally stated 
in the next definition. 


Definition of 
Linear Dependence and 
Linear Independence 


EXAMPLE 7 
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Examples of Linearly Dependent Sets 


EXAMPLE 8 


(a) The set S = {(1, 2), (2, 4)} in R? is linearly dependent because 
—2(1, 2) + (2, 4) = (0, 0). 

(b) The set S = {(1, 0), (0, 1), (—2, 5)} in R? is linearly dependent because 
2(1, 0) — 5(0, 1) + (—2, 5) = (0, 0). 

(c) The set S = {(0, 0), (1, 2)} in R? is linearly dependent because 
1(0, 0) + 0(1, 2) = (0, 0). 


The next example demonstrates a testing procedure for determining whether a set of 
vectors is linearly independent or linearly dependent. 


Testing for Linear Independence 


SOLUTION 


Determine whether the set of vectors in R? is linearly independent or linearly dependent. 
vy, V> V3 
S = {(1, 2, 3), (0, 1, 2), (—2, 0, 1)} 
To test for linear independence or linear dependence, form the vector equation 
CV, + CoV, + €3V; = 0. 
If the only solution of this equation is 
C¢; = ¢, =c, = 0, 


then the set S is linearly independent. Otherwise, S is linearly dependent. Expanding this 
equation, you have 


e,(1, 2,3) + ¢(0, 1, 2) + ¢,(=2, 0,1) = (0,0, 0) 
(ep, = Deg, 2ty ta, 36, F 2c, +c) = (4, 0,0), 
which yields the homogeneous system of linear equations in c,, c,, and c, shown below. 
Cy — 2c, =0 
2c, + Cc, =0 
3c, + 2c, + c,=0 
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Testing for Linear 
Independence and 
Linear Dependence 


EXAMPLE 9 


The augmented matrix of this system reduces by Gauss-Jordan elimination as follows. 


1 Q -=2 0 1 0 0 0 
2 1 0 O| — |0 1 0 0 
3 2 1 0 0 0 1 0 


This implies that the only solution is the trivial solution 
CH= QQ =a =. 


So, S is linearly independent. 


The steps shown in Example 8 are summarized as follows. 


Testing for Linear Independence 


SOLUTION 


Determine whether the set of vectors in P, is linearly independent or linearly dependent. 


v, V> V3 


S = {1 +x — 2x?,2 + 5x — x?,x + x7} 


Expanding the equation c,v, + c,V, + c,V, = 0 produces 
Cle 24) el +e oe = a) ee ee) Se Oa ee 
(ce, + 263) +(e, + Sey + cg)t + (= 26; — e+ ce = 0+ Or + Or, 
Equating corresponding coefficients of equal powers of x produces the homogeneous 
system of linear equations in c,, c,, and c, shown below. 
6b 265 =0 
c, + 5c, +c, = 0 
—2¢,-— €, +e, = 0 
The augmented matrix of this system reduces by Gaussian elimination as follows. 
1 2 0 0 1 2 0 0 
1 5 1 oO] —fo 1 4 O 
0 0 


EXAMPLE 10 
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This implies that the system has an infinite number of solutions. So, the system must have 
nontrivial solutions, and you can conclude that the set S is linearly dependent. 
One nontrivial solution is 


c¢, =2, co=-—I1, and cz =3, 
which yields the nontrivial linear combination 


(2)(1 + x — 2x?) + (—1)(2 + 5x — x7) + (3) + x?) = 0. 


Testing for Linear Independence 


SOLUTION 


Determine whether the set of vectors in M, , is linearly independent or linearly dependent. 


vi Vv, V3 
$= F i 3 | E °| 
0 1) 12 1/12 0 
From the equation 


CV, + CV, + €,V, = 0, 


you have 


2 1 3 0 1 oO] fo o 
alo 1| + eq 5 I eed l= lo 4 


which produces the system of linear equations in c,, c,, and c, shown below. 


2c, + 3c, + c, =0 


Cy =0 
2c, + 2c, =0 
CiAF C5 =0 


Using Gaussian elimination, the augmented matrix of this system reduces as follows. 


2 3 1 «0 i © © @ 
1 0 0 0 1 0 0 
0 2 2 oo) lo @ 7 ® 
1 1 0 0 0 0 0 0 


The system has only the trivial solution and you can conclude that the set S is linearly 
independent. 
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EXAMPLE 11| __ Testing for Linear Independence 
Determine whether the set of vectors in M, , is linearly independent or linearly dependent. 
Vv; V5 V3 V4 
1} }1 0 
O] | 1 a 
e=\\ 24 Pot] “Ap 
O] |2} | -2 2 
SOLUTION From the equation 


CV, + CyV5 + €3V, + cyv, = 0, 


you obtain 
1 1 0 0 0 
0 1 3 1 0 
| wes lec i} 7 “11 =o 
0 2 =2, 2 0 
This equation produces the system of linear equations in c,, c,, c;, and c, shown below. 
Cor. cy =0 
Co + 3c, + ¢, =0 
= + o- co, =0 


2c, — 2c, + 2c, = 0 


Using Gaussian elimination, you can row reduce the augmented matrix of this system as 
follows. 


1 1 0 0 0 1 0 0 0 0 
0 1 3 1 0 . ££ Oo ha 
—1 0 it =-1 o| “™ |6 o 1 6 6 
0 2-2 2 0 0 0 0 1 0 


The system has only the trivial solution, and you can conclude that the set S is linearly 
independent. 


If a set of vectors is linearly dependent, then by definition the equation 
CV, tov, +---+eVv,=90 


has a nontrivial solution (a solution for which not all the c,’s are zero). For instance, 
if c, # 0, then you can solve this equation for v, and write v, as a linear combination of 
the other vectors v,, V3,. . ., and v,. In other words, the vector v, depends on the other 
vectors in the set. This property is characteristic of a linearly dependent set. 


THEOREM 4.8 
A Property of Linearly 
Dependent Sets 


Section 4.4 Spanning Sets and Linear Independence 217 


A set S = {vj, V>,. . .,V,},& = 2, is linearly dependent if and only if at least one of the 
vectors v; can be written as a linear combination of the other vectors in S. 


PROOF To prove the theorem in one direction, assume S is a linearly dependent set. Then there exist 
scalars C,, Cs, C3,. . . , C, (not all zero) such that 
CV, + OV, + OV, +++ +> + eV, = 0. 
Because one of the coefficients must be nonzero, no generality is lost by assuming c, # 0. 
Then solving for v, as a linear combination of the other vectors produces 
C1Vy = CVn — €3V3 — + CV, 
c C c 
Vv, 2, ay, ty, 
Ci Cy cy 
Conversely, suppose the vector v, in S is a linear combination of the other vectors. That is, 
Vi = CoV F C3V3 T+ 1 + CM. 
Then the equation —v, + c,Vv, + ¢3¥; ++ + + + c,v, = 0 has at least one coefficient, — 1, 
that is nonzero, and you can conclude that S is linearly dependent. 
EXAMPLE 12| Writing a Vector as a Linear Combination of Other Vectors 
In Example 9, you determined that the set 
vy V2 V3 
S={14+x-— 2x7,2 + 5x — x*,x + x7} 
is linearly dependent. Show that one of the vectors in this set can be written as a linear 
combination of the other two. 
SOLUTION In Example 9, the equation c,v, + c,V, + c3¥; = 0 produced the system 


c, + 2c, =0 
c, + 5c, +c, = 0 
—2c, -— ¢, +c, =0. 
This system has an infinite number of solutions represented by c, = 3f, c, = —¢, and 


c,; = 2t. Letting t = 1 results in the equation 2v, — v, + 3v; = 0. So, v, can be written 
as a linear combination of v, and vy, as follows. 


Vv, = 2v, + 3v; 
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A check yields 
2+ 5x — x? = 2(1 + x — 2x?) + 3(x + x?) 
= 24 2x — 4x? + 3x + 3x? 
=2+ 5x — x’. 


Theorem 4.8 has a practical corollary that provides a simple test for determining whether 
two vectors are linearly dependent. In Exercise 69 you are asked to prove this corollary. 


THEOREM 4.8 Two vectors u and v in a vector space V are linearly dependent if and only if one is a 
Corollary scalar multiple of the other. 


REMARK: The zero vector is always a scalar multiple of another vector in a vector space. 


EXAMPLE 13] _ Testing for Linear Dependence of Two Vectors 


(a) The set 


vi V5 
S = {(, 2, 0),(=2,2,1)} 
is linearly independent because v, and v, are not scalar multiples of each other, as 
shown in Figure 4.17(a). 
(b) The set 


v 


§= (4 <4, -9), (-2,2, 1) 


is linearly dependent because v, = —2v,, as shown in Figure 4.17(b). 
(a) ‘ (b) i 
34 ot 
Deas 44 


S= {(, 2, 0), (-2, 2, I} S={(4, -4, -2), 2, 2, D} 
The set S is linearly The set S is linearly 
independent. dependent because v; = —2v. 


Figure 4.17 
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AGN aes Exercises 


In Exercises 1—4, determine whether each vector can be written as 
a linear combination of the vectors in S. 
1. S = {(2, —1, 3), (5, 0, 4)} 
(a) u = (1, 1, -1) 
(c) w = (1, —8, 12) 
2. S = {(1, 2, —2), (2, —1, 1)} 
(a) u = (1, —5, —5) (b) v = (—2, —6, 6) 
(c) w = (-1, —22, 22) (d) z = (—4, —3, 3) 
3. S = {(2, 0, 7), (2, 4, 5), (2, —12, 13)} 
(a) u = (1,5, —6) (b) v = (—3, 15, 18) 
() w= (4,43) (d) z = (2, 20, —3) 
4. S = {(6, —7, 8, 6), (4, 6, —4, 1)} 
(a) u = (—42, 113, —112, —60) 
yaa. e147) 
(©) w= (-4, -14, F, 3) 
(d) z = (8,4, -1, 2) 


(b) v = (8, -3,7) 


(d) z = (—1, —2, 2) 


In Exercises 5—16, determine whether the set S spans R?. If the set 

does not span R?, give a geometric description of the subspace that 

it does span. 
5. S = {(2, 1), (-1, 2)} 
7. S = {(5,0), (5, —4)} 8. S = {(2,0), (0, 1)} 
9. S = {(-3,5)} 10. S = {(1, 1)} 

11. S = {(1, 3), (—2, —6), (4, 12)} 

12. 5 = {(1, 2), (-2, —4),(3, 1)} 

13. S = {(—1, 2), (2, —4)} 

14. S = {(0, 2), (1, 4)} 

15. S = {(-1, 4), (4, -1), G, 1)} 

16. S = {(-1, 2), (2, -1), C, 1)} 


6. S = {(, —1), (2, 1)} 


In Exercises 17—22, determine whether the set S spans R°. If the set 
does not span R3, give a geometric description of the subspace that 
it does span. 

176 3 = 14, 7, A152. 2, = 35 5)} 

18. S = {(6, 7, 6), (3, 2, —4), (1, —3, 2)} 

19. S = {(—2, 5, 0), (4, 6, 3)} 

20, 5 = {(1, 0, 0; (1,1, 0), , 1, 1)} 

21. 5 = {(1, —2, 0), (0, 0, 1), (— 1, 2, 0)} 


22. S = {(1, 0, 3), (2, 0, — 1), (4, 0, 5), (2, 0, 6)} 


In Exercises 23-34, determine whether the set S$ is linearly 
independent or linearly dependent. 

23. S = {(—2, 2), (3, 5)} 24. S = {(—2, 4), (1, —2)} 

25. S = {(0, 0), (1, —1)} 26. S = {(1, 0), (1, 1), (2, -1)} 
27. S = {(1, —4, 1), (6, 3, 2)} 

28. S = {(6, 2, 1), (-1, 3, 2)} 

29. S = {(1, 1, 1), (2, 2, 2), (3, 3, 3)} 

30. 5 = {(§, 3.3), (3, 4,3), (-3, 6, 2)} 

31. S = {(—4, —3, 4), (1, —2, 3), (6, 0, 0)} 

32. S = {(1, 0, 0), (0, 4, 0), (0, 0, —6), (1, 5, —3)} 

33. S = {(4, —3, 6, 2), (1, 8, 3, 1), (3, —2, —1, 0)} 

34. S = {(0, 0, 0, 1), (0,0, 1, 1), (0, 1, 1, 1), (1, 1, 1, 1} 

In Exercises 35-38, show that the set is linearly dependent by 
finding a nontrivial linear combination (of vectors in the set) whose 
sum is the zero vector. Then express one of the vectors in the set as 
a linear combination of the other vectors in the set. 

35. S = {(3, 4), (-1, 1), (2, 0)} 

36. S = {(2, 4), (—1, —2), (0, 6)} 

37. S = {(1, 1, 1), G, 1, 0), (0, 1, 1), (0, 0, 1)} 

38. S = {(1, 2, 3, 4), (1, 0, 1, 2), (1, 4, 5, 6)} 


39. For which values of fis each set linearly independent? 
(a) S = {(7, 1, 1), 4,1), (1, 1,9} 
(b) S = {(t, 1, 1), C1, 0, 1), C, 1, 34} 

40. For which values of tis each set linearly independent? 
(a) S = {(z, 0, 0), (0, 1, 0), (0, 0, 1)} 
(b) S = {(t, t, 2), (t, 1, 0), (¢, 0, 1)} 

41. Given the matrices 


2 es 
A= | | and B= i | 
4 1 I =2 


in M,,, determine which of the matrices listed below are linear 
combinations of A and B. 
(b) k | 
9 Ii 


la “a 
@Mlio 7 


2 28 0 0 
© | 1 Z| |p | 
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42. Determine whether the following matrices from M,, form a 
linearly independent set. 


b a | 4 | 1 3 
A= , B= , C= 
4 5 -2 3 22 23 


In Exercises 43-46, determine whether each set in P, is linearly 
independent. 

43. S = {2 — x, 2x — x7,6 — 5x + x?} 

44. S = {x? — 1,2x + 5} 

45. S = {x + 3x + 1, 2x7 + x — 1, 4x} 

46. S = {x?,x? + 1} 

47. Determine whether the set S = {1, x*, x? + 2} spans P,. 


48. Determine whether the set S = {x? — 2x,x° + 8,x° — x’, 
x? — 4} spans P,. 


49. By inspection, determine why each of the sets is linearly 
dependent. 


(a) S= {(, —2), (2, 3), (=2, 4)} 
(b) S = {(1, —6, 2), (2, — 12, 4)} 


(c) S = {(0, 0), (1, 0)} 
50. Complete the proof of Theorem 4.7. 


In Exercises 51 and 52, determine whether the sets S, and S, span 
the same subspace of R?. 


51. S, = {(, 2, -1), (0, 1, 1), (2,5, —1)} 
S, = {(—2, —6, 0), (1, 1, —2)} 

52. S, = {(0, 0, 1), (0, 1, 1), (2, 1, 1)} 
S, = {(, 1, 1), (, 1, 2), (2, 1, 1} 


True or False? In Exercises 53 and 54, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


53. (a) A set of vectors S = {v,, V>,. . ., V,} in a vector space is 
called linearly dependent if the vector equation c,v, + 

CoV, ++ + + + €,¥, = 0 has only the trivial solution. 
(b) Two vectors u and v in a vector space V are linearly 
dependent if and only if one is a scalar multiple of the other. 


54. (a) Aset S = {v,,V>,. . .,V,},& = 2, is linearly independent 
if and only if at least one of the vectors v, can be written as 
a linear combination of the other vectors. 


(b) If a subset S spans a vector space V, then every vector 
in V can be written as a linear combination of the vectors 
in S. 


In Exercises 55 and 56, prove that the set of vectors is linearly 
independent and spans R°. 


55. B = {(1, 1, 1), (1, 1, 0), (1, 0, 0)} 
56. B = {(1, 2, 3), (3, 2, 1), (0, 0, 1)} 


57. Guided Proof Prove that a nonempty subset of a finite set of 
linearly independent vectors is linearly independent. 


Getting Started: You need to show that a subset of a linearly 
independent set of vectors cannot be linearly dependent. 


(i) Suppose S is a set of linearly independent vectors. Let 
T be a subset of S. 


(ii) If T is linearly dependent, then there exist constants 
not all zero satisfying the vector equation c,v, + 
CV, +--+ + ey, = 0. 

(iit) Use this fact to derive a contradiction and conclude 
that T is linearly independent. 


58. Prove that if S$, is a nonempty subset of the finite set S,, and S, 
is linearly dependent, then so is S,. 


59. Prove that any set of vectors containing the zero vector is 
linearly dependent. 


60. Provided that {u,,u,,.. .,u,,} is a linearly independent set 
of vectors and that the set {u,,uU,,...,u,,Vv} is linearly 
dependent, prove that v is a linear combination of the u,’s. 


61. Let {v,, v.,. . ., v,} bea linearly independent set of vectors in 
a vector space V. Delete the vector v, from this set and prove that 
the set {V,, V>,. . ., V,—,} cannot span V. 


62. If V is spanned by {v,, V>,. . ..V,} and one of these vectors 
can be written as a linear combination of the other k — 1 
vectors, prove that the span of these k — 1 vectors is also V. 


63. Writing The set {(1, 2, 3), (1, 0, —2), (—1, 0, 2)} is linearly 
dependent, but (1, 2, 3) cannot be written as a linear combina- 
tion of (1, 0, —2) and (—1, 0, 2). Why does this statement not 
contradict Theorem 4.8? 


64. Writing Under what conditions will a set consisting of a 
single vector be linearly independent? 


65. Let S = {u, v} be a linearly independent set. Prove that the set 
{u + v,u — v} is linearly independent. 

66. Let u,v, and w be any three vectors from a vector space V. 
Determine whether the set of vectors {v — u, w — v, u — w} 
is linearly independent or linearly dependent. 


67. Let f,(x) = 3x and f,(x) = |x|. Graph both functions on the 
interval —2 < x < 2. Show that these functions are linearly 
dependent in the vector space C[0, 1], but linearly independent 
in C[—1, 1]. 
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68. Writing Let A be a nonsingular matrix of order 3. Prove that 69. Prove the corollary to Theorem 4.8: Two vectors u and v are 
if {V,, V2, V3} is a linearly independent set in M ,, then the set linearly dependent if and only if one is a scalar multiple of 
{Av,, AV>, AV;} is also linearly independent. Explain, by means the other. 


of an example, why this is not true if A is singular. 


Figure 4.18 


Definition of Basis 


EXAMPLE 1 


4.5 | Basis and Dimension 


In this section you will continue your study of spanning sets. In particular, you will look at 
spanning sets (in a vector space) that both are linearly independent and span the entire 
space. Such a set forms a basis for the vector space. (The plural of basis is bases.) 


A set of vectors S = {v,, V>,. . ., V,,} in a vector space V is called a basis for V if the 
following conditions are true. 


1. S spans V. 2. Sis linearly independent. 


REMARK: This definition tells you that a basis has two features. A basis S must have 
enough vectors to span V, but not so many vectors that one of them could be written as a 
linear combination of the other vectors in S. 


This definition does not imply that every vector space has a basis consisting of a finite 
number of vectors. In this text, however, the discussion of bases is restricted to those con- 
sisting of a finite number of vectors. Moreover, if a vector space V has a basis consisting of 
a finite number of vectors, then V is finite dimensional. Otherwise, V is called infinite 
dimensional. [The vector space P of all polynomials is infinite dimensional, as is the vector 
space C(—oo, co) of all continuous functions defined on the real line.] The vector space 
V = {0}, consisting of the zero vector alone, is finite dimensional. 


The Standard Basis for R? 


(0, 0, 1) 
SOLUTION 


Show that the following set is a basis for R?. 

S _ {(, 0, 0), (0, 1; 0), (0, 0, 1)} 
Example 4(a) in Section 4.4 showed that S spans R?. Furthermore, S is linearly independent 
because the vector equation 

c,(1, 0, 0) + c,(0, 1, 0) + c3(0, 0, 1) = (0, 0, 0) 


has only the trivial solution c, = c, = c, = 0. (Try verifying this.) So, S is a basis for R?. 
(See Figure 4.18.) 
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EXAMPLE 2 


The basis S = {(1, 0, 0), (0, 1, 0), (0, 0, 1)} is called the standard basis for R°. This result 
can be generalized to n-space. That is, the vectors 


e, = (1,0,. . ., 0) 
e, = (0, 1, , 0) 
e, = (0,0,. . .,1) 


form a basis for R” called the standard basis for R”. 
The next two examples describe nonstandard bases for R? and R?. 


The Nonstandard Basis for R? 


SOLUTION 


Show that the set 
v, V5 
S = {(1, 1), (1, -D} 
is a basis for R2. 


According to the definition of a basis for a vector space, you must show that S spans R? and 
S is linearly independent. 
To verify that S spans R?, let 


x = (x,,x,) 


represent an arbitrary vector in R?. To show that x can be written as a linear combination 
of v, and v,, consider the equation 


CV, + CoV, = X 
é (1; 1) + ef1,.=1) = ex) 
(cy + Cy, Cy — C5) = (), X). 
Equating corresponding components yields the system of linear equations shown below. 
GF Cy Xj 
Cj — ho = Xe 
Because the coefficient matrix of this system has a nonzero determinant, you know that the 


system has a unique solution. You can now conclude that S spans R?. 
To show that S is linearly independent, consider the linear combination 


cv, + ov, = 90 
cl.1) +-es(l, — 1) = (0,0) 
(Pty ty = 6) = (0,0). 
Equating corresponding components yields the homogeneous system 
c, +o, = 0 


qc, = 0. 


EXAMPLE 3 
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Because the coefficient matrix of this system has a nonzero determinant, you know that the 
system has only the trivial solution 
cy =e, = 0. 


So, you can conclude that S$ is linearly independent. 
You can conclude that S is a basis for R* because it is a linearly independent spanning 
set for R?. 


A Nonstandard Basis for R? 


EXAMPLE 4 


From Examples 5 and 8 in the preceding section, you know that 
S = 401, 2,.3),10, 1, 2), (= 2,0).1)5 


spans R? and is linearly independent. So, S is a basis for R?. 


A Basis for Polynomials 


SOLUTION 


Show that the vector space P, has the basis 


S11 ..5%,.37,9°3. 


It is clear that S spans P, because the span of S consists of all polynomials of the form 
dy + ayx + dyx* + a,x3, do, a), dy, and a, are real, 


which is precisely the form of all polynomials in P,. 
To verify the linear independence of S, recall that the zero vector 0 in P, is the polyno- 
mial 0(x) = 0 for all x. The test for linear independence yields the equation 


dy + ayx + ayx* + a,x* = O(x) = 0, for all x. 


This third-degree polynomial is said to be identically equal to zero. From algebra you know 
that for a polynomial to be identically equal to zero, all of its coefficients must be zero; 
that is, 


dy = a, = a, = a, = 0. 


So, S is linearly independent and is a basis for P3. 


REMARK: The basis S = {1, x, x7, x3} is called the standard basis for P;. Similarly, the 
standard basis for P,, is 


S = {1,x,x7,.. ., x7}. 
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EXAMPLE 5 


A Basis for Mp2 


THEOREM 4.9 
Uniqueness of 
Basis Representation 


PROOF 


EXAMPLE 6 


The set 


EI Ie Ie 3 


is a basis for M, ,. This set is called the standard basis for M, ,. In a similar manner, the 
standard basis for the vector space M,,,,, consists of the mn distinct m x n matrices having 


a single | and all the other entries equal to zero. 


The existence portion of the proof is straightforward. That is, because S spans V, you know 
that an arbitrary vector u in V can be expressed as u = c,V,; + C,V, ++ + + + €,V,,. 

To prove uniqueness (that a vector can be represented in only one way), suppose u has 
another representation u = bv, + b,v, +: - - + b,v,,. Subtracting the second represen- 
tation from the first produces 


u—u=(c, — b,)v, + (co — b)vy +--+ > + (c, — 5, )v, = 9. 


Because S is linearly independent, however, the only solution to this equation is the trivial 
solution 


c, — b, = 90, co -b,=0, ..., ¢, —b, = 9, 
which means that c; = b; for alli = 1,2,. . .,. So, u has only one representation for the 
basis S. 


Uniqueness of Basis Representation 


SOLUTION 


Let u = (uj, v5, u;) be any vector in R>. Show that the equation u = c,v, + c,V, + €3V3 
has a unique solution for the basis S = {v,, v,, v3} = {(1, 2, 3), (0, 1, 2), (—2, 0, I}. 


From the equation 


(aj, 15, 7%.) = C101, 2,3) +60, 1, 2) + (= 2,0, 1) 
= (ey = 2e5, 26) + a, 36, # 2c +e), 


the following system of linear equations is obtained. 


THEOREM 4.10 
Bases and 
Linear Dependence 


PROOF 
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C; — 2¢, = uy, 1 0 -2||\c, uy 
2c, + C, = ub 2 1 O})c,) =] uy 
3c, + 2c, + C3 =U, 3 2 l}Le, Uz 

A é u 


Because the matrix A is invertible, you know this system has a unique solution e = A~'u. 
Solving for A~! yields 


=] 4 -2 
Al=]/ 2 -7 4], 
=] 2 =I 
which implies 
Cc; = —u, + 4u, — 2u, 
Cy = 2u, — Tuy + 4u; 
C, = —&, + 2u, — Uy. 


For instance, the vector u = (1, 0, 0) can be represented uniquely as a linear combination 
of v,, V5, and v; as follows. 


(1, 0,0) = —v, + 2v, — v, 


You will now study two important theorems concerning bases. 


If S = {v,, V>,. . -, V,} is a basis for a vector space V, then every set containing more 
than n vectors in V is linearly dependent. 


Let S; = {u,,u,,. . .,u,,} be any set of m vectors in V, where m > n. To show that S, is 
linearly dependent, you need to find scalars k,, k,,. . ., k,, (not all zero) such that 
ku, + ku, t+---+k,u,,= 0. Equation 1 


Because S is a basis for V, it follows that each u, is a linear combination of vectors in S, 
and you can write 


Uy, = CyVy + CyVn +e + CV, 
Uy = CV + CV. +++ + + CV, 
Uu,, = CimV1 aly ComV2 sem op ComVin- 


Substituting each of these representations of u; into Equation | and regrouping terms produces 


-+tdyv =0, 


non 


dv, +dav,+:-: 
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EXAMPLE 7 


where d; = ck, + Ck, ++ + + + Ck, Because the v,’s form a linearly independent 
set, you can conclude that each d; = 0. So, the system of equations shown below is 
obtained. 

Cyyky + Cyoky +++ + C1, Km = O 


= 0 


m 


Cok, + Copky +++ + + C5,,k 


m 


Cy ky mk Cyk> ae 2 Cum®mn = 0 
But this homogeneous system has fewer equations than variables k,, k,,. . .,k,,, and from 
Theorem 1.1 you know it must have nontrivial solutions. Consequently, S, is linearly 


dependent. 


Linearly Dependent Sets in R? and P; 


THEOREM 4.11 
Number of Vectors 
in a Basis 


PROOF 


(a) Because R? has a basis consisting of three vectors, the set 
S = {(, 2, -1), (, 1, 0), (2, 3, 0), (5, 9, —1)} 
must be linearly dependent. 
(b) Because P, has a basis consisting of four vectors, the set 
S={1l,l+x,1—x,1+x+4x7,1 — x + x?} 


must be linearly dependent. 


Because R” has the standard basis consisting of n vectors, it follows from Theorem 4.10 
that every set of vectors in R” containing more than n vectors must be linearly dependent. 
Another significant consequence of Theorem 4.10 is shown in the next theorem. 


If a vector space V has one basis with n vectors, then every basis for V has n vectors. 


Let 

S, = {Vj,Vo,---5V,t 
be the basis for V, and let 

S, = {w,u,...,u,} 


be any other basis for V. Because S, is a basis and S, is linearly independent, Theorem 4.10 
implies that m < n. Similarly, n < m because S, is linearly independent and S, is a basis. 
Consequently, n = m. 
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EXAMPLE 8| Spanning Sets and Bases 


Use Theorem 4.11 to explain why each of the statements below is true. 


(a) The set S, = {(3, 2, 1), (7, —1, 4)} is not a basis for R°. 
(b) The set 


Sy = {x + 2,x7,x3 — 1, 3x + 1, x? — 2x + 3} 


is not a basis for P3. 


SOLUTION (a) The standard basis for R? has three vectors, and S, has only two. By Theorem 4.11, S, 
cannot be a basis for R?. 
(b) The standard basis for P;, S = {1, x, x*, 2°}, has four elements. By Theorem 4.11, the 
set S, has too many elements to be a basis for P3. 


The Dimension of a Vector Space 


The discussion of spanning sets, linear independence, and bases leads to an important 
notion in the study of vector spaces. By Theorem 4.11, you know that if a vector space V 
has a basis consisting of n vectors, then every other basis for the space also has n vectors. 
The number 7 is called the dimension of V. 


Definition of Dimension 
of a Vector Space 


This definition allows you to observe the characteristics of the dimensions of the 
familiar vector spaces listed below. In each case, the dimension is determined by simply 
counting the number of vectors in the standard basis. 


1. The dimension of R” with the standard operations is n. 
2. The dimension of P,, with the standard operations is n + 1. 
3. The dimension of M,,,,, with the standard operations is mn. 


If W is a subspace of an n-dimensional vector space, then it can be shown that W is finite 
dimensional and the dimension of W is less than or equal to n. (See Exercise 81.) In the 
next three examples, you will look at a technique for determining the dimension of a 
subspace. Basically, you determine the dimension by finding a set of linearly independent 
vectors that spans the subspace. This set is a basis for the subspace, and the dimension of 
the subspace is the number of vectors in the basis. 
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EXAMPLE 9 


Finding the Dimension of a Subspace 


SOLUTION 


EXAMPLE 10 


Determine the dimension of each subspace of R?. 
(a) W = {(d,c — d,c): c and d are real numbers} 
(b) W = {(2b, b, 0): b is a real number} 


The goal in each example is to find a set of linearly independent vectors that spans the 
subspace. 
(a) By writing the representative vector (d, c — d, c) as 
(d,c — d,c) = (0,c, c) + (d, —d, 0) 
c(0, 1, 1) + d(l, —1, 0), 


you can see that W is spanned by the set 
S = {(0, 1, 1), 1, —1, 0)}. 


Using the techniques described in the preceding section, you can show that this set 
is linearly independent. So, it is a basis for W, and you can conclude that W is a two- 
dimensional subspace of R?. 


(b) By writing the representative vector (2b, b, 0) as 
(2b, b, 0) = b(2, 1, 0), 


you can see that W is spanned by the set S = {(2, 1, 0)}. So, W is a one-dimensional 
subspace of R?. 


REMARK: In Example 9(a), the subspace W is a two-dimensional plane in R? determined by 
the vectors (0, 1, 1) and (1, — 1, 0). In Example 9(b), the subspace is a one-dimensional line. 


Finding the Dimension of a Subspace 


SOLUTION 


Find the dimension of the subspace W of R* spanned by 
v1 Va Ws 


S= 11 1,2,5,.0),40,0, 1, = 2), (-3,4,9; 2). 


Although W is spanned by the set S, S is not a basis for W because S is a linearly dependent 
set. Specifically, v, can be written as a linear combination of v, and v, as follows. 
v, = 2v, — Vv, 


This means that W is spanned by the set S, = {v,, v.}. Moreover, S, is linearly independ- 
ent because neither vector is a scalar multiple of the other, and you can conclude that the 
dimension of W is 2. 


EXAMPLE 11 
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Finding the Dimension of a Subspace 


SOLUTION 


THEOREM 4.12 
Basis Tests in an 
n-Dimensional Space 


EXAMPLE 12 


Let W be the subspace of all symmetric matrices in M, ,. What is the dimension of W? 


Every 2 x 2 symmetric matrix has the form listed below. 


a ie ee 4 


So, the set 


oa (ee) Fg | 


spans W. Moreover, S can be shown to be linearly independent, and you can conclude that 
the dimension of W is 3. 


Usually, to conclude that a set 


S={v,,V..--,V,} 


is a basis for a vector space V, you must show that S' satisfies two conditions: § spans V and 
is linearly independent. If V is known to have a dimension of n, however, then the next 
theorem tells you that you do not need to check both conditions: either one will suffice. The 
proof is left as an exercise. (See Exercise 82.) 


Testing for a Basis in an n-Dimensional Space 


Show that the set of vectors is a basis for M5). 


— 
So 
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SOLUTION Because S has five vectors and the dimension of M, , is five, you can apply Theorem 4.12 to 
verify that S is a basis by showing either that S is linearly independent or that S spans M, |. 
To show the first of these, form the vector equation 


CV, + CyV5 + €3V, + CyVy + C5V5 = 0, 


which yields the homogeneous system of linear equations shown below. 


cy 
26) F* 


6, 1 33 F 2c, 


3c, — 2c, — 


Ac, + 3c, + 5c; — 


C3 + 2c4 - 
3c, — 2c, = 0 


Because this system has only the trivial solution, S must be linearly independent. So, by 
Theorem 4.12, S is a basis for M; ,. 


SANTO eee Exercises 


In Exercises 1—6, write the standard basis for the vector space. 


1. RS 2. R4 3. M,, 
4. M,, 5. P, 6. P, 


Writing In Exercises 7-14, explain why S is not a basis for R?. 


7, S = {(1, 2), (1, 0), (0, 1)} 

8. S = {(-1, 2), (1, —2), (2, 4)} 
9. 5 = {(—4, 5), (0, 0)} 

10. S = {(2, 3), (6, 9)} 

11. S = {(6, —5), (12, —10)} 
12. S = {(4, —3), (8, —6)} 

13. § = {(-3, 2)} 

14. § = {(-1,2)} 


Writing In Exercises 15-20, explain why S is not a basis for R°. 
15,..8 = {(1, 3,0), 4 1,2), (2,35, -2)} 

16. § = {@, 1, —2),(-2, — 1,2), 4,2, -4)} 

17. S = {(7, 0, 3), (8, —4, 1)} 

18. S = {(1, 1, 2), (0, 2, 1)} 


19. S = {(0, 0, 0), (1, 0, 0), (0, 1, 0)} 
20. S = {(6, 4, 1), (3, —5, 1), (8, 13, 6), (0, 6, 9)} 


Writing In Exercises 21-24, explain why S is not a basis for P3. 
21. S = {1, 2x, x? — 4, 5x} 

22. S = {2,x,x + 3, 3x?} 

23. S= {1 — x, 1 — x7, 3x? — 2x — 1} 

24. S = {6x — 3, 3x2, 1 — 2x — x?} 


Writing In Exercises 25-28, explain why S is not a basis for Mj 5. 


wef He 
asf IE IG OS 
asf 42 4G a 


In Exercises 29-34, determine whether the set {v,, v5} is a basis 


for R?. 

29. y 30. y 

A 
1 1+ 

My 
4 
-1 Vo 1 

a 1 pS as 
31. y 32. y 
A A 


V2 vj 
>X | {—> x 
-1 1 
ai 
33: 34, y 
A 
1 
vy Vo 
x 
-1 1 
> xX -il+ 


In Exercises 35—42, determine whether S is a basis for the indicated 
vector space. 


35. 
36. 
37. 
38. 
39. 
40. 
41. 
42. 


S = {(3, —2), (4, 5)} for R? 

S = {(1, 2), (1, —1)} for R? 

S = {(1, 5, 3), (0, 1, 2), (0, 0, 6)} for R? 

S = {(2, 1,0), (0, -1, 1)} for R? 

S = {(0, 3, —2), (4, 0, 3), (—8, 15, — 16)} for R? 

S = {(0, 0, 0), (1, 5, 6), (6, 2, 1)} for R? 

S = {(-1, 2, 0, 0), (2, 0, —1, 0), (3, 0, 0, 4), (0, 0, 5, 0)} for R* 
S = {(1, 0, 0, 1), (0, 2, 0, 2), (1, 0, 1, 0), (0, 2, 2, 0)} for R* 


44, 
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In Exercises 45—48, determine whether S is a basis for P3. 


45.S={P —-2P + 1,2 —4,8 + 21, 52} 
46. S = {4t — 7,5 + P,3¢ + 5,2P — 37} 
47. S = {4 — 4,27, 6f, ? + 32, 4t — 1} 


48. 


S={P — 1,2°,¢1+ 3,5 + 2r + 277 + 2} 


In Exercises 49-54, determine whether S is a basis for R°. If it is, 
write u = (8, 3, 8) as a linear combination of the vectors in S. 


49. 
50. 
51. 
52. 
53. 


54. 


S= {(4, 3, 2), (0, 3; 2), (0, 0, 2)t 
S = {(1, 0, 0), (1, 1, 0), (1, 1, 1)} 
S = {(0, 0, 0), (1, 3, 4), (6, 1, —2)} 
S = {(1, 0, 1), (0, 0, 0), (0, 1, 0)! 
s = {(,3, 1), (1,3, 0), (2, 12, 0} 
§= {0,4 7), (3, 0, 1), (2, 1, 2)} 


In Exercises 55—62, determine the dimension of the vector space. 


55. R° 56. R* 57. R 58. R° 
59. P, 60. Py 61.M,, 62. M;, 
63. Find a basis for D,, (the vector space of all 3 x 3 diagonal 


64. 


65. 


66. 


67. 
68. 


matrices). What is the dimension of this vector space? 

Find a basis for the vector space of all 3 x 3 symmetric 
matrices. What is the dimension of this vector space? 

Find all subsets of the set that forms a basis for R?. 
S={(1,0), (0; 1), yt 

Find all subsets of the set that forms a basis for R°. 
S = {(1, 3, —2), (—4, 1, 1), (—2, 7, —3), (2, 1, 1)} 

Find a basis for R? that includes the vector (1, 1). 

Find a basis for R? that includes the set §S = {(1, 0, 2), (0, 1, 1)}. 


In Exercises 69 and 70, (a) give a geometric description of, (b) find 
a basis for, and (c) determine the dimension of the subspace W 
of R?. 


69. 
70. 


W = {(2t, t): tis a real number} 
W = {(0, 0: tis a real number} 


In Exercises 43 and 44, determine whether S'is a basis for M, 5. 
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In Exercises 71 and 72, (a) give a geometric description of, (b) find 
a basis for, and (c) determine the dimension of the subspace W of 
R>. 

71. W = {(2t, t, —2): tis a real number} 

72. W = {(2t — t, s,t): s and fare real numbers} 
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In Exercises 73—76, find (a) a basis for and (b) the dimension of the 
subspace W of R’. 

73. W = {(2s — t,s, t, s): s and fare real numbers} 

74. W = {(5t,— 32, ¢, t): tis a real number} 

75. W = {(0, 6t, t, —f): tis a real number} 

76. W = {(s + 4f, t, s, 2s — t): s and fare real numbers} 


True or False? In Exercises 77 and 78, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, pro- 
vide an example that shows the statement is not true in all cases or 
cite an appropriate statement from the text. 


77. (a) If dim(V) = 2, then there exists a set of n — 1 vectors in V 
that will span V. 


(b) If dim(V) = n, then there exists a set of n + 1 vectors in V 
that will span V. 


78. (a) If dim(V) = n, then any set of n + 1 vectors in V must be 
linearly dependent. 


(b) If dim(V) = n, then any set of n — 1 vectors in V must be 
linearly independent. 

79. Prove that if S = {v,,v,,...,v,} is a basis for a vector 
space V and c is a nonzero scalar, then the set S, = 
{cV,, cV,,. . ., CV,} is also a basis for V. 

80. Prove that the vector space P of all polynomials is infinite 
dimensional. 

81. Prove that if W is a subspace of a finite-dimensional vector space 
V, then (dimension of W) < (dimension of V). 


82. Prove Theorem 4.12. 


83. Writing 
(a) Let S; = span((1, 0, 0), (1, 1, 0)) and S, = span((0, 0, 1), 
(0, 1,0)) be subspaces of R?. Find a basis for and the 
dimension of each of the subspaces S,,$,,$,  S,, and 
S, + S,. (See Exercise 47 in Section 4.3) 


(b) Let S, and S, be two-dimensional subspaces of R°. Is it 
possible that S$, M S, = {(0, 0, 0)}? Explain. 


84. Guided Proof Let S be a spanning set for the finite 
dimensional vector space V. Prove that there exists a subset S’ 
of S that forms a basis for V. 


Getting Started: S is a spanning set, but it may not be a basis 
because it may be linearly dependent. You need to remove extra 
vectors so that a subset S’ is a spanning set and is also linearly 
independent. 


(i) If S is a linearly independent set, you are done. If not, 
remove some vector v from S that is a linear combina- 
tion of the other vectors in S. 


(ii) Call this set S,. If S, is a linearly independent set, you 
are done. If not, continue to remove dependent vectors 
until you produce a linearly independent subset S$’. 

(iii) Conclude that this subset is the minimal spanning 
set $”. 

85. Let S be a linearly independent set of vectors from the finite 
dimensional vector space V. Prove that there exists a basis for V 
containing S. 

86. Let V be a vector space of dimension n. Prove that any set of less 
than n vectors cannot span V. 


4.6 | Rank of a Matrix and Systems of Linear Equations 


In this section you will investigate the vector space spanned by the row vectors (or column 
vectors) of a matrix. Then you will see how such spaces relate to solutions of systems of 


linear equations. 


To begin, you need to know some terminology. For an m Xx n matrix A, the n-tuples 
corresponding to the rows of A are called the row vectors of A. 


a, Ay 

a a 
a= |@ te 

Gn Gn2 


Row Vectors of A 


Gy, Ay, 495+ + +> Ayn 
Ayn (41, Go9, +'y,) 
Ginn (Gas Qn2> ? Ann) 


EXAMPLE 1 
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Similarly, the columns of A are called the column vectors of A. You will find it useful 
to preserve the column notation for these column vectors. 


Column Vectors of A 


4, 42 Ay, 41, |] 4% Qn 
A= Ay, 421} | 42 Ay, 
Gn And Ginn Gin\ Ang Ginn 


Row Vectors and Column Vectors 


Definitions of Row Space 
and Column Space 
of a Matrix 


THEOREM 4.13 
Row-Equivalent Matrices 
Have the Same Row Space 


PROOF 


For the matrix 


a=| 0 1 “sf 
=2 3 4 


the row vectors are (0, 1, — 1) and (—2, 3, 4) and the column vectors are 
0 1 = 
Lok Lak me [a 
—2 3 4 


In Example 1, note that for an m x n matrix A, the row vectors are vectors in R” and the 
column vectors are vectors in R”. This leads to the two definitions of the row space and 
column space of a matrix listed below. 


Let A be an m X n matrix. 


1. The row space of A is the subspace of R” spanned by the row vectors of A. 
2. The column space of A is the subspace of R” spanned by the column vectors of A. 


As it turns out, the row and column spaces of A share many properties. Because of your 
familiarity with elementary row operations, however, you will begin by looking at the row 
space of a matrix. Recall that two matrices are row-equivalent if one can be obtained from 
the other by elementary row operations. The next theorem tells you that row-equivalent 
matrices have the same row space. 


If an m X n matrix A is row-equivalent to an m x n matrix B, then the row space of A is 
equal to the row space of B. 


Because the rows of B can be obtained from the rows of A by elementary row operations 
(scalar multiplication and addition), it follows that the row vectors of B can be written as 
linear combinations of the row vectors of A. The row vectors of B lie in the row space of A, 
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THEOREM 4.14 
Basis for the Row Space 
of a Matrix 


EXAMPLE 2 


and the subspace spanned by the row vectors of B is contained in the row space of A. But it 
is also true that the rows of A can be obtained from the rows of B by elementary row 
operations. So, you can conclude that the two row spaces are subspaces of each other, 
making them equal. 


REMARK: Note that Theorem 4.13 says that the row space of a matrix is not changed by 
elementary row operations. Elementary row operations can, however, change the column 
space. 


If a matrix B is in row-echelon form, then its nonzero row vectors form a linearly 
independent set. (Try verifying this.) Consequently, they form a basis for the row space of 
B, and by Theorem 4.13 they also form a basis for the row space of A. This important result 
is stated in the next theorem. 


If a matrix A is row-equivalent to a matrix B in row-echelon form, then the nonzero row 
vectors of B form a basis for the row space of A. 


Finding a Basis for a Row Space 


SOLUTION 


Find a basis for the row space of 


1 3 1 3 


1 1 0 

A= |-3 0 6 =1}. 
3 4 -2 1 
2 0 -4 -2 


Using elementary row operations, rewrite A in row-echelon form as follows. 


1 3 1 3) w, 
o 1 1 O| w, 
B=|0 0 O 1] w, 
0 0 0 0 
6 0 © 6 


By Theorem 4.14, you can conclude that the nonzero row vectors of B, 
w, = (1,3, 1,3), ws =(0,1,1,0), and w, = (0,0,0, 1), 


form a basis for the row space of A. 


EXAMPLE 3 
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The technique used in Example 2 to find the row space of a matrix can be used to solve 
the next type of problem. Suppose you are asked to find a basis for the subspace spanned 
by the set S = {v,,v,,. . ., V,} in R”. By using the vectors in S to form the rows of a 
matrix A, you can use elementary row operations to rewrite A in row-echelon form. The 
nonzero rows of this matrix will then form a basis for the subspace spanned by S. This is 
demonstrated in Example 3. 


Finding a Basis for a Subspace 


SOLUTION 


Find a basis for the subspace of R? spanned by 
vy, V5 V3 


S = {(-1, 2, 5), (3, 0, 3), (5, 1, 8)}. 


Use v,, V>, and v; to form the rows of a matrix A. Then write A in row-echelon form. 
= 2 5] y, lL =2, —3 | a, 
A=| 3 0 3) vy. =» B=|0 1 3] w, 
5 1 8] Vv; 0 0 0 

So, the nonzero row vectors of B, 

w, = (1, -2,-5) and w, = (0, 1,3), 
form a basis for the row space of A. That is, they form a basis for the subspace spanned by 
S = {v1 Vo, V3}. 

To find a basis for the column space of a matrix A, you have two options. On the one 
hand, you could use the fact that the column space of A is equal to the row space of A’ and 
apply the technique of Example 2 to the matrix A’. On the other hand, observe that although 
row operations can change the column space of a matrix, they do not change the depend- 
ency relationships between columns. You are asked to prove this fact in Exercise 71. 

For example, consider the row-equivalent matrices A and B from Example 2. 

1 3 1 3 1 3 1 3 
0 1 1 0 0 1 1 0 
A= |=3 0 6. =1 B=|0 0 0 1 
3 4 -2 1 0 0 0 0 
2 0 =4 =2 0 0 0 0 
ay a a3 ay b, b, b; b, 
Notice that columns 1, 2, and 3 of matrix B satisfy the equation b, = —2b, + b,, and so 


do the corresponding columns of matrix A; that is, 
a, = —2a, + a. 


Similarly, the column vectors b,, b,, and b, of matrix B are linearly independent, and so 
are the corresponding columns of matrix A. 
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EXAMPLE 4 


The next example shows how to find a basis for the column space of a matrix using both 
of these methods. 


Finding a Basis for the Column Space of a Matrix 


SOLUTION 1 


SOLUTION 2 


Find a basis for the column space of matrix A from Example 2. 


1 3 1 3 


1 1 0 

A= |-3 0 6. =1 
3 4 -2 1 

2 0 -4 -2 


Take the transpose of A and use elementary row operations to write A’ in row-echelon form. 


1 0 =3 3 2 1 0 -3 3 2| w, 

AT = 3 1 0 4 0 mies 0 1 9 =) =6:| 
1 1 6 -2 -4 0 0 1 =l =1| 9, 
3 0 -l 1 =2 0 0 0 0 0 


So, w, = (1, 0, —3, 3, 2), w> = (0, 1,9, —5, —6), and w; = (0,0, 1, —1, —1) form a 
basis for the row space of A’. This is equivalent to saying that the column vectors 


1 0 0) 
0) 1 0 
=3'|, 9], and 1 
3 =5 =i, 
2 —6 —1 


form a basis for the column space of A. 


In Example 2, row operations were used on the original matrix A to obtain its row-echelon 
form B. It is easy to see that in matrix B, the first, second, and fourth column vectors are 
linearly independent (these columns have the leading 1’s). The corresponding columns of 
matrix A are linearly independent, and a basis for the column space consists of the vectors 


1 3 3 
1 0 

—3], 0}, and —1). 
3 4 1 
2 0 —2 


Notice that this is a different basis for the column space than that obtained in the first 
solution. Verify that these bases span the same subspace of R°. 


THEOREM 4.15 
Row and Column Spaces 
Have Equal Dimensions 


PROOF 
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REMARK: Notice that in the second solution, the row-echelon form B indicates which 
columns of A form the basis of the column space. You do not use the column vectors of B 
to form the basis. 


Notice in Examples 2 and 4 that both the row space and the column space of A have a 
dimension of 3 (because there are three vectors in both bases). This is generalized in the 
next theorem. 


If A is an m xX n matrix, then the row space and column space of A have the same 
dimension. 


Let V,, V>,. . ., and v,, be the row vectors and u,, U5,. . . , and u,, be the column vectors 
of the matrix 


41, G2 +++ Ay 
A=a| 21 % Ay, 
an 1 And Ginn 
Suppose the row space of A has dimension r and basis S$ = {b,, b,,. . .,b,} where 
b; = (b,,,b,. . .,0;,). Using this basis, you can write the row vectors of A as 
Vv, = c,,b, + c,.b, +--+ + c,,b, 
V> = Cob, + cCyb, ++ + + + Cp,b, 
Vin = CD, + C2Dy oe BP ale CD, 


Rewrite this system of vector equations as follows. 


[ay 142° : din] = CLD Dy2 : -b,,] a CyaLDybo9 ° : Dy] ee eae C1Lb pb, ° _ 
[ap)Ay9 + ; Ay, = Cold 112° : -b,,] + Colby bo9 * . Dy] si a Cop LD Dy * “ 


Lan Gn2 st Any| = Cmil P1112 7? b,,] + Cal Bo1B29 asia by,| sa Curl PnP2 7 Deal 


Now, take only entries corresponding to the first column of matrix A to obtain the system 
of scalar equations shown below. 


Ay, = Cy Dy + Cypba) + Cy3b3, H+ + CyB 
Ay, = Cy4Dy, + Cydn) + Cy3b3, + + C5,d, 
3, = C3,D\, + C39b9) + €33b3, H+ + C3,D, 
Ant = Cm + C224 ay C331 ae Cm Prt 
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Definition of the 
Rank of a Matrix 


Similarly, for the entries of the jth column you can obtain the system below. 


ay; = Cy); + Cyd; + C133; tere +t C1,b,; 
ay; — Cyd); + Cydp; aa Cy3D3; fe FE Se Cy,D,; 
a3; = 3D); + C3); + C333; feet C3,D,,; 
Ginj = CP 1; + C29; a Cn303 seh Sot ce Aa 
Now, let the vectors ¢; = [¢,;C5;: - * CJ". Then the system for the jth column can be 


rewritten in a vector form as 


u; = 5, ,¢, + be, +--+ + 5, ¢,. 

Put all column vectors together to obtain 
UW, = [ay a+ - +a]? = b,0, + bye +--+ + bys, 
[ayy Gg9* + Ayg|” = bye, + byt, ++ + + dye, 


_ / ec 
u, = [a,, a, 7 Any, D,,€, by,> " + b,,¢ 


in? rae” 
Because each column vector of A is a linear combination of r vectors, you know that the 
dimension of the column space of A is less than or equal to r (the dimension of the row 


space of A). That is, 
dim(column space of A) < dim(row space of A). 


Repeating this procedure for A’, you can conclude that the dimension of the column space 
of A’ is less than or equal to the dimension of the row space of A’. But this implies that the 
dimension of the row space of A is less than or equal to the dimension of the column space 
of A. That is, 


dim(row space of A) < dim(column space of A). 


So, the two dimensions must be equal. 


The dimension of the row (or column) space of a matrix has the special name provided 
in the next definition. 


The dimension of the row (or column) space of a matrix A is called the rank of A and is 
denoted by rank(A). 


REMARK: Some texts distinguish between the row rank and the column rank of a matrix. 
But because these ranks are equal (Theorem 4.15), this text will not distinguish between 
them. 


EXAMPLE 5 
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Finding the Rank of a Matrix 


SOLUTION 


THEOREM 4.16 
Solutions of a 
Homogeneous System 


Find the rank of the matrix 


I = 2 0 1 
A= |2 1 5°: =3'|. 
0 1 3 5 


Convert to row-echelon form as follows. 


1 =2 0 1 Il =2 0 1 
A= |2 1 5 -—3| => B=)|0 1 1 =I] 
0 1 3 5 0 0 1 3 


Because B has three nonzero rows, the rank of A is 3. 


The Nullspace of a Matrix 


The notions of row and column spaces and rank have some important applications to 
systems of linear equations. Consider first the homogeneous linear system 


Ax =0 
where A is anm x nmatrix,x =[x, x, ... x,]"is the column vector of unknowns, and 
0=[0 0... OJ] is the zero vector in R”. 
44, 42+ ++ Ay || %4 0 
Gy 492+ + + Ayn | |X] | O 
Gnt4n2+ + + Gun Xn 0 


The next theorem tells you that the set of all solutions of this homogeneous system is a 
subspace of R”. 
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PROOF 


EXAMPLE 6 


Because A is an m X n matrix, you know that x has size n x 1. So, the set of all solutions of 
the system is a subset of R”. This set is clearly nonempty, because AO = 0. You can verify 
that it is a subspace by showing that it is closed under the operations of addition and scalar 
multiplication. Let x, and x, be two solution vectors of the system Ax = 0, and let c be a 
scalar. Because Ax, = 0 and Ax, = 0, you know that 


A(x, + x,) = Ax, + Ax, =0+0=0 Addition 
and 
A(cx,) = c(Ax,) = c(0) = 0. Scalar multiplication 


So, both (x, + x,) and cx, are solutions of Ax = 0, and you can conclude that the set of 
all solutions forms a subspace of R”. 


REMARK: The nullspace of A is also called the solution space of the system Ax = 0. 


Finding the Solution Space of a Homogeneous System 


SOLUTION 


Find the nullspace of the matrix. 
1 2. =2 1 

A=]3 6 —5 4 

1 2 0 3 


The nullspace of A is the solution space of the homogeneous system Ax = 0. 

To solve this system, you need to write the augmented matrix [A : 0] in reduced 
row-echelon form. Because the system of equations is homogeneous, the right-hand column 
of the augmented matrix consists entirely of zeros and will not change as you do row 
operations. It is sufficient to find the reduced row-echelon form of A. 


1 2. = 2 1 1 2 0 3 
A=13 6 —5 4| —»> |0 0 1 1 
it 2 0 3 0 0 0 0 


The system of equations corresponding to the reduced row-echelon form is 


ye 2X5 + 3x,=0 
Xe t+ x, = 0. 


Choose x, and x, as free variables to represent the solutions in this parametric form. 


x, = 2s —- 34 mH Ss, BSH KL my St 


THEOREM 4.17 


Dimension of the 
Solution Space 
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This means that the solution space of Ax = 0 consists of all solution vectors x of the form 
shown below. 


x, =2§ =3t =2 =3 
Xs RY 1 0 
ed el =s5 +t 
X3 =I 0 = 
X4 t 0 1 
A basis for the nullspace of A consists of the vectors 
= —3 
1 0 
and : 

0 =] 
0 1 


In other words, these two vectors are solutions of Ax = 0, and all solutions of this 
homogeneous system are linear combinations of these two vectors. 


REMARK: Although the basis in Example 6 proved that the vectors spanned the solution 
set, it did not prove that they were linearly independent. When homogeneous systems are 
solved from the reduced row-echelon form, the spanning set is always independent. 


In Example 6, matrix A has four columns. Furthermore, the rank of the matrix is 2, and 
the dimension of the nullspace is 2. So, you can see that 


Number of columns = rank + nullity. 
One way to see this is to look at the reduced row-echelon form of A. 


1 2 0 3 
0 0 1 1 
0 0 0 0 


The columns with the leading 1’s (columns | and 3) determine the rank of the matrix. The 
other columns (2 and 4) determine the nullity of the matrix because they correspond to the 
free variables. This relationship is generalized in the next theorem. 


If A is an m x n matrix of rank r, then the dimension of the solution space of Ax = 0 is 
Tatas 


n = rank(A) + nullity(A). 
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PROOF 


EXAMPLE 7 


Because A has rank r, you know it is row-equivalent to a reduced row-echelon matrix B with 
r nonzero rows. No generality is lost by assuming that the upper left corner of B has the form 
of the r x r identity matrix [,. Moreover, because the zero rows of B contribute nothing to 
the solution, you can discard them to form the r x n matrix B’, where B’ = [I, : C]. The 
matrix C has n — r columns corresponding to the variables x, |, X,..,. - -5X,- S50, the 
solution space of Ax = 0 can be represented by the system 


x, + CipXpa + CppX% 42 H+ +X, = 0 
Xy + CarX p41 + Cok py $+ + + Cy p—pXy = 0 
x,. ae CX +1 a C,oX 42 aa Cc, n—r*n = 0. 


Solving for the first r variables in terms of the last n — r variables produces n — r vectors 
in the basis of the solution space. Consequently, the solution space has dimension n — r. 


Example 7 illustrates this theorem and further explores the column space of a matrix. 


Rank and Nullity of a Matrix 


SOLUTION 


Let the column vectors of the matrix A be denoted by aj, a,, a3, a,, and as. 


1 Q: =2 1 0 
O° +1 =3 1 3 
=2. =1 1 =! 3 
0 3 9 0 —12 
ay ay a3 a, as 


(a) Find the rank and nullity of A. 
(b) Find a subset of the column vectors of A that forms a basis for the column space of A. 
(c) If possible, write the third column of A as a linear combination of the first two columns. 


A= 


Let B be the reduced row-echelon form of A. 


1 0 -2 1 0 1 QO: = 0 1 

ee 0 =I =3 1 3 <5 Spe 0 1 3 0 —-4 
=2. =1 1 -1l 3 0 0 0 1. =] 

0 3 9 0-12 0 0 0 0 0 

a, ay a; ay as b, by b; by bs 


(a) Because B has three nonzero rows, the rank of A is 3. Also, the number of columns of 
A is n = 5, which implies that the nullity of A ism — rank = 5 — 3 = 2. 
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(b) Because the first, second, and fourth column vectors of B are linearly independent, the 
corresponding column vectors of A, 


1 0 
0 -1 
a, = _yh a= 1p and a, = ib 
0 3 0 
form a basis for the column space of A. 
(c) The third column of B is a linear combination of the first two columns: b,; = —2b, + 
3b,. The same dependency relationship holds for the corresponding columns of matrix A. 
—2 1 0 
=3 0 =I 
a; = 1 ==2 _9 ae ee = —2a, + 3a, 
9 0 3 


Solutions of Systems of Linear Equations 


You now know that the set of all solution vectors of the homogeneous linear system Ax = 0 
is a subspace. Is this true also of the set of all solution vectors of the nonhomogeneous 
system Ax = b, where b # 0? The answer is “no,” because the zero vector is never a 
solution of a nonhomogeneous system. There is a relationship, however, between the sets 
of solutions of the two systems Ax = 0 and Ax = b. Specifically, if x, is a particular 
solution of the nonhomogeneous system Ax = b, then every solution of this system can be 
written in the form 


x=x, +X, 


Solution Solution 
of Ax =b of Ax = 0 


where x, is a solution of the corresponding homogeneous system Ax = 0. The next 
theorem states this important concept. 


THEOREM 4.18 
Solutions of a 
Nonhomogeneous 
Linear System 
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PROOF 


EXAMPLE 8 


Let x be any solution of Ax = b. Then (x — x,) is a solution of the homogeneous system 
Ax = 0, because 


A — x,) = Ax — Ax, = b-—b=0. 


Letting x, = x — X,, you have x = x, + X;,. 


Finding the Solution Set of a Nonhomogeneous System 


SOLUTION 


THEOREM 4.19 
Solutions of a System of 
Linear Equations 


Find the set of all solution vectors of the system of linear equations. 


x; —2x%, + x = 5 
3x, + Xx — 5x3 = 8 
xX, + 2x, —3x,= —-9 


The augmented matrix for the system Ax = b reduces as follows. 


1 Q =-2 1 3 1 O74 2 1 5 
3 | en) 0 8| —= |0 1 i 3 7 
1 2 0. =3, =9 0 0 0 0 0 


The system of linear equations corresponding to the reduced row-echelon matrix is 


x, = hsb x= 5 
Xp + xg. — 3xyg = 7. 


Letting x, = s and x, = f, you can write a representative solution vector of Ax = b as follows. 


x, 28 = 25 2 =] 5 

Xo =s-b.3f= 7 =] 3 =7 
Bee a =5 + tf + 

X; s+ 0t+0 1 0 0 

Xi Os + t+0 0 1 0 


= su, + 1, +x, 


You can see that x, is a particular solution vector of Ax = b, and x, = su, + fu, repre- 
sents an arbitrary vector in the solution space of Ax = 0. 


The final theorem in this section describes how the column space of a matrix can be used 
to determine whether a system of linear equations is consistent. 


EXAMPLE 9 
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Let 
a, Ay Ain x, b, 
A= — 2 - ‘ x= 2 - and b= be 
a fig ae anes Ann x, b 
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be the coefficient matrix, the column matrix of unknowns, and the right-hand side, 


respectively, of the system Ax = b. Then 


Gy, jg © Ay | | XY AyyXy + AyyXy Fe + Ay Xy 
45, A979 + + + Ann | | X20 AgXy + AgyXy Fo + + AyyX, 
Ax =|. : : a : : : 

Qint An2 re Ginn Xn Qin X) + An2X2 ae ar Se Ginx 

ay a1 Ain 

a a a 

21 22 2n 
=X, +X). | + + x, 
a a 


mi m2 Ginn 


So, Ax = b if and only if b is a linear combination of the columns of A. That is, the system 


is consistent if and only if b is in the subspace of R” spanned by the columns of A. 


Consistency of a System of Linear Equations 


Consider the system of linear equations 


xX, + %—x,=—-1 
x; tig = 3 
3x, + 2x,-x,= 1. 


The rank of the coefficient matrix is equal to the rank of the augmented matrix. 


1 1 =1 1 0 1 
A= {1 0 1 0 1 4 

3 2. =| 0 0 0 
1 
0 


i f =i =i o da 3 
[Ai bl=]1 0 1 3) —> { =y =4 
3 2 =f jf 0 0 0 0 


As shown above, b is in the column space of A, and the system of linear equations is 


consistent. 
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Systems of Linear Equations with 
Square Coefficient Matrices 


The final summary in this section presents several major results involving systems of linear 
equations, matrices, determinants, and vector spaces. 


Summary of Equivalent If A is ann x n matrix, then the following conditions are equivalent. 


. A is invertible. 

. Ax = b has a unique solution for any n x | matrix b. 
. Ax = 0 has only the trivial solution. 

. A is row-equivalent to /,,. 


Conditions for 1 
2 
3 
4 
5. |A| #0 
6 
7 
8 


Square Matrices 


. Rank(A) =n 
. The n row vectors of A are linearly independent. 
. The n column vectors of A are linearly independent. 


SECTION 4.6 Exercises 


In Exercises 1—12, find (a) the rank of the matrix, (b) a basis for the 4 0 ) 3 1 
row space, and (c) a basis for the column space. 2 =] 2 0 1 
1 0 a) 4 12. | 5 2 2 1. =! 
» lo | A F | 4 0. 2 2 
3[1 2 3] ae 1 =] a ee 
5 F —3 | 6. | 1 2 4 In Exercises 13-16, find a basis for the subspace of R? spanned by S. 
4 2 1 =i 2 1 
a: bo a 1 a W 13. $= {(1, 2,4), (-1,3, 4), 2,3, D} 
7.16 —5 =6 8. |5 10 6 14. S= {(4, 2, —1),(, 2, —8), (0, 1, 2)} 
2 1-16 =) 5 15. S = {(4, 4, 8), (1, 1, 2), (1, 1, 1)} 
2 4 -3 - 16. S = {(1, 2, 2), (—1, 0, 0), (1, 1, 1 
ek ae 8 3 -6 (1, 2,2), (=1, 0,0), (1, 1, 1)} 
9. 3 6. S36. 24 10. 7 4 -6 —3 In Exercises 17-20, find a basis for the subspace of R* spanned by S. 
—2 —4 1 =2 
a ee > 4-2 -2 17,8 = (2,9, =2, 53), (3, 2,3, —2),48, =3,.= 8,17); 
2 4 -2 1 1 (0, —3, 0, 15)} 
2 5 4 -2 2 18. S = {(6, —3, 6, 34), (3, —2, 3, 19), (8, 3, —9, 6), 
11. | 4 3 1 1 2 (—2, 0, 6, —5)} 
2 —-4 2 -1 1 tp ics 
19. S = {(—3, 2, 5, 28), (—6, 1, —8, —1), (14, — 10, 12, — 10), 
0 1 4 2 —1 
(0, 5, 12, 50)} 


20. S = {(2, 5, =—3, =2),(—2,.—3, 2, —5), (1, 3, —2, 2), 
(=1,=5,4;5)) 
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In Exercises 21—32, find a basis for, and the dimension of, the 
solution space of Ax = 0. 


2. =i 2 1 
aa=[? ma-[ 2H 
1 3 “6 3 
23.A=[1 2 3] 24.A=[1 4 2] 
sgele 2 3) eae * 2 
0 f © 0 0 1 
tl 2 =3 2°26 2 
27.A=|2 -1 4 28.A=|-2 4 —-14 
4 3 -2 f =2: 9 
1 3-2 4 
2.A=| 0 1-1 2 
=% =6 4 -=8 
1 4 2 1 
30.A=| 0 1 1 -1 
—2 -8 -4 -2 
2 © 2 Wi 1 4 2 1 
2 Lf — =2 a=) £ 
cee oe ee) okie ae ee 
0 6 2 0 0 4 2 40 


In Exercises 33—40, find (a) a basis for and (b) the dimension of the 
solution space of the homogeneous system of linear equations. 


33. -—x+ y+ z=0 34. 4x —- yt+2z=0 
34> =0 24 3y = Z=0 
2x — 4y — 5z=0 3x y z=0 

35. x— 2y + 3z=0 36. x+2y- 42,=0 


—3x + 6y — 9z =0 —3x — 6y + 12z=0 
37. 3x, + 3x, + 15x; + 1llx, =0 

Xx, — 3x, X3 X= 0 

2x, + 3x, + 11x, 8x, = 0 


38. 2x, + 2x, + 4x, — 2x, = 0 
x + 2x5 x, + 2x, = 0 
x, Xy + 4x, — 2x, = 0 
39. 9x, — 4x, — 2x3; — 20x, = 0 
12x, — 6x, — 4x, — 29x, = 0 
3x, — 2x, = Tk = 0 
3X, = 2x5 X3 8x, = 0 


40. x, + 3x, + 2x; + 22x, + 13x, = 0 
% x3 2X4 x; =0 
3x, + 6x, + 5x3 + 42x, + 27x; = 0 


In Exercises 41—46, (a) determine whether the nonhomogeneous 
system Ax = b is consistent, and (b) if the system is consistent, 
write the solution in the form x = x, + x,, where x, is a solution 
of Ax = 0 and x, is a particular solution of Ax = b. 


41. x»«+3y+ 10z = 18 42. 3x — 8y + 42 = 19 
2x + Ty + 32z = 29 6y 2z+4w= 5 
x + 3y + 14z = 12 5x 22z w = 29 
x y 2z 8 x= 2y+ 2z = 8 


43. 3w — 2x + loy 22°57 


w+ 5x — 14y + 18z= 29 
3w x + 14y 2z 1 
44. 2x- 4y4+5z= 8 


45. x 2X X3 X4 5x5 = 0O 
3x, — 10x, + 3x, + 3x, + 55x35 = 
xy 2Xy + 2x3 — 3X4 5x5 = 14 
x 2x5 X3 xy + 13x, = —2 
46. 5x, — 4x, + 12x, — 33x, + 14x, = —4 
2X; + X5 6x, + 12x, 8x5 1 
2X1 Xy 6x, — 12x, 8x5 = —1 


In Exercises 47—50, determine whether b is in the column space of A. 
If it is, write b as a linear combination of the column vectors of A. 


eaeft ofl 


_f-1 2] ._f2 
a.a=[") jh [7] 
1 3 0 
a] 1 0) b= 
2 0 1 = 
i 7 3 1 
aa] i 3) b=/4 
o # 4 0 
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51. Writing Explain why the row vectors of a 4 x 3 matrix form 
a linearly dependent set. (Assume all matrix entries are distinct.) 


52. Writing Explain why the column vectors of a 3 x 4 matrix 
form a linearly dependent set. (Assume all matrix entries are 
distinct.) 


53. Prove that if A is not square, then either the row vectors of A or 
the column vectors of A form a linearly dependent set. 


54. Give an example showing that the rank of the product of two 
matrices can be less than the rank of either matrix. 


55. Give examples of matrices A and B of the same size such that 
(a) rank(A + B) < rank(A) and rank(A + B) < rank(B) 
(b) rank(A + B) = rank(A) and rank(A + B) = rank(B) 
(c) rank(A + B) > rank(A) and rank(A + B) > rank(B). 
56. Prove that the nonzero row vectors of a matrix in row-echelon 
form are linearly independent. 


57. Let A be an m Xx n matrix (where m < n) whose rank is r. 


(a) What is the largest value r can be? 

(b) How many vectors are in a basis for the row space of A? 

(c) How many vectors are in a basis for the column space 
of A? 

(d) Which vector space R* has the row space as a subspace? 

(e) Which vector space R* has the column space as a 
subspace? 


58. Show that the three points (x), y,), (%, y2), and (x3, y;) in a 
plane are collinear if and only if the matrix 


x) yi 1 
x V2 1 
3 3 1 
has rank less than 3. 


59. Given matrices A and B, show that the row vectors of AB are in 
the row space of B and the column vectors of AB are in the 
column space of A. 


60. Find the ranks of the matrix 


1 2 So eas n 
n+1 n+2 n+3 -:+: 2n 
2n+ 1 2n+2 2n+3 ++: 3n 

n—n 1 wn 2 wn 3 toe we 


for n = 2, 3, and 4. Can you find a pattern in these ranks? 


61. Prove each property of the system of linear equations in n 
variables Ax = b. 


(a) If rank(A) = rank([A : b]) =n, then the system has a 
unique solution. 


(b) If rank(A) = rank([A : b]) <n, then the system has 
an infinite number of solutions. 

(c) If rank(A) < rank([A : b]), then the system is 
inconsistent. 


True or False? In Exercises 62—65, determine whether each state- 
ment is true or false. If a statement is true, give a reason or cite an 
appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


62. (a) The nullspace of A is also called the solution space of A. 


(b) The nullspace of A is the solution space of the homogeneous 
system Ax = 0. 


63. (a) If an m x n matrix A is row-equivalent to an m x n matrix 
B, then the row space of A is equivalent to the row space 
of B. 


(b) If A is an m x n matrix of rank r, then the dimension of the 
solution space of Ax = 0ism — r. 


64. (a) If an m x n matrix B can be obtained from elementary row 
operations on an m x n matrix A, then the column space of 
B is equal to the column space of A. 


(b) The system of linear equations Ax = b is inconsistent if and 
only if b is in the column space of A. 


65. (a) The column space of a matrix A is equal to the row space of A’. 


(b) Row operations on a matrix A may change the dependency 
relationships among the columns of A. 


In Exercises 66 and 67, use the fact that matrices A and B are 
row-equivalent. 


(a) Find the rank and nullity of A. 

(b) Find a basis for the nullspace of A. 

(c) Find a basis for the row space of A. 

(d) Find a basis for the column space of A. 

(e) Determine whether or not the rows of A are linearly 
independent. 

(f) Let the columns of A be denoted by aj, a5, a3, ay, and as. 
Which of the following sets is (are) linearly independent? 


(i) {a,, a5, ag} (ii) {a), a, as} (iii) {a,, as, as} 
0 
66. A = 


ww = 


oCoOrF COC ONNW 
| 
SG OrFRFW WNP Re 


oo oF 


—2 -5§ 8 O-1I7 
1 3-5 ft 5 
ee 3 1-19 #7 1 
1 7-13 5 -3 
1 Oo 1 0 1 
0 1-2 0 3 
B=)o 0 0 1 —5 
0 0 0 0 0 


68. Let A be an m x n matrix. 
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(b) Prove that the homogeneous system of linear equations 
Ax = 0 has only the trivial solution if and only if the 
columns of A are linearly independent. 


69. Let A and B be square matrices of order n satisfying Ax = Bx 
for all x © R”. 


(a) Find the rank and nullity of A — B. 
(b) Show that A and B must be identical. 


70. Let A be an m x n matrix. Prove that N(A) C MATA). 


71. Prove that row operations do not change the dependency 
relationships among the columns of an m x n matrix. 


(a) Prove that the system of linear equations Ax = b is 
consistent for all column vectors b if and only if the 


rank of A is m. 


Coordinate Representation 
Relative to a Basis 


4.7 | Coordinates and Change of Basis 


In Theorem 4.9, you saw that if B is a basis for a vector space V, then every vector x in V 
can be expressed in one and only one way as a linear combination of vectors in B. The 
coefficients in the linear combination are the coordinates of x relative to B. In the context 
of coordinates, the order of the vectors in this basis is important, and this will sometimes 
be emphasized by referring to the basis B as an ordered basis. 


Let B = {v,, V>,. . ., V,} be an ordered basis for a vector space V and let x be a vector 
in V such that 


CCN ar Chin ar 2 8 Sar Ae 


The scalars c,, c5,. . .,¢, are called the coordinates of x relative to the basis B. The 
coordinate matrix (or coordinate vector) of x relative to B is the column matrix in R” 
whose components are the coordinates of x. 


Cy 
oy 
[x], = : 
e 


Coordinate Representation in R" 


In Rk”, the notation for coordinate matrices conforms to the usual component notation, 
except that column notation is used for the coordinate matrix. In other words, writing a 
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vector in R” as x = (x,,%5,. . .,x,) means that the x;’s are the coordinates of x relative to 
the standard basis S in R". So, you have 
aa 
x2 
[x]; =| - |. 
x 


n 


EXAMPLE 1| Coordinates and Components in R” 


Find the coordinate matrix of x = (—2, 1, 3) in R? relative to the standard basis 
S = {(1, 0, 0), (0, 1, 0), (0, 0, 1)}. 
SOLUTION Because x can be written as 


x = (—2, 1,3) = —2(1, 0,0) + 1(0, 1, 0) + 3(0, 0, 1), 


you can see that the coordinate matrix of x relative to the standard basis is simply 
=2 
Ix]; =| 1}. 
3 


So, the components of x are the same as its coordinates relative to the standard basis. 


EXAMPLE 2 Finding a Coordinate Matrix Relative to a Standard Basis 


The coordinate matrix of x in R? relative to the (nonstandard) ordered basis B = {v,, v,} = 


{(1, 0), (1, 2)} is 
3 
xl -| >| 
Find the coordinates of x relative to the standard basis B’ = {u,, u,} = {(1, 0), (0, 1)}. 
3 
SOLUTION Because [x], = FE you can write 


x = 3v, + 2v, = 3(1, 0) + 2(1, 2) = (5, 4). 


Moreover, because (5, 4) = 5(1, 0) + 4(0, 1), it follows that the coordinates of x relative 
to B’ are 


a(S 


Figure 4.19 compares these two coordinate representations. 
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pure a0) ‘ x = 5(1,0) + 4(0, 1) 


eG) | Pdp= [i] 


(3, 2) (5,4) | 
® eos 


Vy 3vy 
Nonstandard basis: , Standard basis: 
B ={(, 0), (1, 2)} B' = {(1, 0), (0, 1)} 
Figure 4.19 


Example 2 shows that the procedure for finding the coordinate matrix relative to a 
standard basis is straightforward. The problem becomes a bit tougher, however, when you 
must find the coordinate matrix relative to a nonstandard basis. Here is an example. 


EXAMPLE 3 Finding a Coordinate Matrix Relative to a Nonstandard Basis 


Find the coordinate matrix of x = (1, 2, —1) in R? relative to the (nonstandard) basis 
B’ = {u,, w, uz} = {(1, 0, 1), (0, — 1, 2), (2, 3, —5)}. 


SOLUTION Begin by writing x as a linear combination of u,, U5, and us. 


X = CU, + CoU, + C3U, 
(1,2,=1): = 40,0, 1) + 6G, = 1,2) + (2,3, —5) 


Equating corresponding components produces the following system of linear equations. 


Cc} +2c,= 1 
=, t3c3= 2 
GF 23 = Sez = —1 
1 0 2) ) ¢, 1 
0 -I 3}|co,])=] 2 
1 2 —5ILe, —1 
The solution of this system is c, = 5, c, = —8, and c,; = —2. So, 


x= 501, 0,1) (8), =—1,2) #(=—2)@,3, =5), 
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and the coordinate matrix of x relative to B’ is 


[x], =| —8]. 


REMARK: Note that the solution in Example 3 is written as 


It would be incorrect to write the solution as 


5 
x=|/-—8]. 
—2 


Do you see why? 


Change of Basis in R" 


The procedure demonstrated in Examples 2 and 3 is called a change of basis. That is, you 
were provided with the coordinates of a vector relative to one basis B and were asked to 
find the coordinates relative to another basis B’. 

For instance, if in Example 3 you let B be the standard basis, then the problem of find- 
ing the coordinate matrix of x = (1, 2, — 1) relative to the basis B’ becomes one of solving 
for c,, Cy, and c3 in the matrix equation 


1 0 2| | c, 1 

0 =1 3||¢2] = 2). 

1 2 —5I Le, —1 
a Ix], [x], 


The matrix P is called the transition matrix from B’ to B, where [x], is the coordinate 
matrix of x relative to B’, and [x], is the coordinate matrix of x relative to B. Multiplication 
by the transition matrix P changes a coordinate matrix relative to B’ into a coordinate 
matrix relative to B. That is, 

PLx]y- = [x]p. Change of basis from B’ to B 
To perform a change of basis from B to B’, use the matrix P~! (the transition matrix from 
B to B’) and write 


[x],, = P-'[x],. Change of basis from B to B’ 
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This means that the change of basis problem in Example 3 can be represented by the matrix 


equation 
ra -1 4 2 1 5 
c}=| 3 -7 -3 2)|=|-8)}. 
C3 1 -—2 -1]L-1 =D, 


a [x], [x], 
This discussion generalizes as follows. Suppose that 
B= {v,,Vo,-- ->Vyt and B’= {u,,u,,...,u,} 


are two ordered bases for R”. If x is a vector in R” and 


Cy d, 
C d. 
Ixly=| 2] and xl =] 
Gn d, 


are the coordinate matrices of x relative to B and B’, then the transition matrix P from B’ 
to B is the matrix P such that 


[x], =P [x], 


The next theorem tells you that the transition matrix P is invertible and its inverse is the 
transition matrix from B to B’. That is, 


[x], = P“[x\,. 


Coordinate Transition Coordinate 


matrix of X matrix matrix of x 
relative to B' from B to B' relative to B 


THEOREM 4.20 
The Inverse of a 
Transition Matrix 


Before proving Theorem 4.20, you will prove a preliminary lemma. 
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LEMMA Let B= {v,,v>, ...,v,} and B’ = {u,,u, . . . ,u,,} be two bases for a vector 
space V. If 
V, = CU, + CU, ++ + CU, 
V2 = CyQUy + Coy F °° * + Cpu, 
Vn — Cindy as C,Ug ais eve Crp» 


PROOF (OF LEMMA) 


then the transition matrix from B to B’ is 


Ci Cy oo 2 Cin 
oe Cy Gy oo o Gp 
CoRRGE eee Gre 
Let 
v=dv,+dv,+---+4d,, 


be an arbitrary vector in V. The coordinate matrix of v with respect to the basis B is 


dy 
d, 
Lv]5 ee ea 
d, 
Then you have 
Cy Cy +--+ Cin |[d, C144, + Cyd, + ° + > + 4, 
_ | 21 C22 + + + Con} | da] | Cardy + Cody + °° + + €5,d, 
Olv], = : : oH ce . . . 
Cnt Cn2 + + + Cnn d, nid + Cndy sta sti Sot te Candy 


On the other hand, you can write 


v=dyv,+dv,+--:-+d,y, 
_ d(c,,u, Aes a P CU) Sega se d,{c,,.My Sess or CoA, 
= (dicy, ey aa d,,C1,)U, ae ear (dic ae oe AC) Uy 
which implies 
Cyd, + Cyd, +++ + + c,d, 
= Cyd, + Cyd, ++ + + + Cod, 
[vla =| : 
CQ as C495 Heyes, eras Canty 


So, Qlv], = Lv],- and you can conclude that Q is the transition matrix from B to B’. 


PROOF (OF THEOREM 4.20) 


THEOREM 4.21 
Transition Matrix 
from B to B’ 


PROOF 
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From the preceding lemma, let Q be the transition matrix from B to B’. Then 


Lv], = Ply: and Lv], = Olv],. 


which implies that [v], = PQ[v], for every vector v in R”. From this it follows that 
PQ =I. So, P is invertible and P~! is equal to Q, the transition matrix from B to B’. 


There is a nice way to use Gauss-Jordan elimination to find the transition matrix P~!. 
First define two matrices B and B’ whose columns correspond to the vectors in B and B’. 
That is, 


Vir Vio Vin Uy, Uy Un 
v v v Uu u u 
21 22 2n 21 U2 2n 
B= : and B’=)|. ; 
Vn il V2 Van Un, il Un2 Unn 
Vv, V5 v uu u 


Then, by reducing the n x 2n matrix [B’ : B] so that the identity matrix J,, occurs in place 
of B’, you obtain the matrix [J, : P~']. This procedure is stated formally in the next 
theorem. 


Let B = {v),V>,. . .,v,} and B’= {u,,u,,. . .,u,} be two bases for R”. Then the 
transition matrix P~! from B to B’ can be found by using Gauss-Jordan elimination on the 
n Xx 2n matrix [B’ : B], as follows. 


[ei Bl] —e [Ff Po 


To begin, let 


V) = CU, + cy, +++ + + ¢,)0, 
Vo = CyWy + Cyl Fe + + + Cyt, 
Vi, = c,,U, + Cy,Uy age ete Cin 


which implies that 


Uy, Uy) Uny Vit 
u u Uu V; 
12 22 n2 i2 
Cj) = | eal Pe eee) 2 pS] s 
Un, Udy, Unn Vin 
fori = 1,2,. . .,n. From these vector equations you can write the n systems of linear 


equations 
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EXAMPLE 4 


UyyCqyz F UgyCa, FF Uy Cys = Vig 
UyyC yj, F Ug Cy, FF UyyCy;s = Vin 
UAC i; + Ug, C2; 2 em Unn€ni = Vin 
fori = 1,2,. . .,n. Because each of the m systems has the same coefficient matrix, you 


can reduce all n systems simultaneously using the augmented matrix below. 


Uy, Ug) Uny Vir Vor Val 

Ujn Ugg Un2 Vio Vo Vn2 

u In Udy Uny v In Von Van 
BS B 


Applying Gauss-Jordan elimination to this matrix produces 


1 0O--: 0 ; Cyy Cig Cin 
0: Lees J : Cop Can Can 
0 0O.:-:: I : Cri (Cig, TRAC 


By the lemma following Theorem 4.20, however, the right-hand side of this matrix is 
Q = P~!, which implies that the matrix has the form 


[I : P~'], which proves the theorem. 


In the next example, you will apply this procedure to the change of basis problem from 
Example 3. 


Finding a Transition Matrix 


SOLUTION 


Find the transition matrix from B to B’ for the following bases in R?. 
B= {(1, 0,0), (0,1,0),(0,0,1)} and B’= {(1,0, 1), (0,—1,2), (2,3,—5)} 


First use the vectors in the two bases to form the matrices B and B’. 


1 0 0 1 0 2 
B=10 1 0 and B’=/0 -1 3 
0 0 1 1 2 =5 


Then form the matrix [B’ : B] and use Gauss-Jordan elimination to rewrite [B’ : B] as 
Le. 2 Pe 


_ 
i) 
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From this you can conclude that the transition matrix from B to B’ is 


-1 4 2 
pt=| 3 -7 -3). 
1 -2 -1 


Try multiplying P~! by the coordinate matrix of 


=] 


to see that the result is the same as the one obtained in Example 3. 
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Discovery 


change of basis is from a nonstandard basis to a standard basis. 


let B = {(1,0), (1,2)} and B’ = {(1, 0), (0, 1)}. Form the matrix [B’ : B]. Make a conjecture 
about the necessity of using Gauss-Jordan elimination to obtain the transition matrix P~' if the 


Note that when B is the standard basis, as in Example 4, the process of changing 
[B’ : B]to[Z, : P7'] becomes 


[B’: 1] — 1, : Pull. 


But this is the same process that was used to find inverse matrices in Section 2.3. In other 


words, if B is the standard basis in R”, then the transition matrix from B to B’ is 


P-!= (B71. Standard basis to nonstandard basis 


The process is even simpler if B’ is the standard basis, because the matrix [B’ : 


already in the form 
dye? B= 2 Pe) 
In this case, the transition matrix is simply 


P'=B. Nonstandard basis to standard basis 


For instance, the transition matrix in Example 2 from B = {(1, 0), (1, 2)} to B’ = 


(0, 1)} is 


EXAMPLE 5| __ Finding a Transition Matrix 


Find the transition matrix from B to B’ for the following bases for R?. 


B = {(-3, 2), (4, —2)} and B’ = {(-1, 2), (2, —2)} 


B] is 


(1, 0), 
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SOLUTION 


Technology 
Note 


Begin by forming the matrix 


ie ee ee 2) 23 4 
[B: Bl=|~) —2.: | 
and use Gauss-Jordan elimination to obtain the transition matrix P~! from B to B’: 
1. OF %%. sD 
: p-ly= : 
ly i Po k 1 = =2 a 


So, you have 


p=[7! , 
-2 3) 


Most graphing utilities and computer software programs have the capability to augment two 
matrices. After this has been done, you can use the reduced row-echelon form command to find 
the transition matrix P~' from B to B’. For example, to find the transition matrix P~! from B to B’ in 
Example 5 using a graphing utility, your screen may look like: 


alt BPRIME, Bo 
[{-1 2 
“2 


Use a graphing utility or a computer software program with matrix capabilities to find the transition 
matrix P from B’ to B. Keystrokes and programming syntax for these utilities/programs applicable to 
Example 5 are provided in the Online Technology Guide, available at college hmco.com/pic/ 
larsonELA6e. 


In Example 5, if you had found the transition matrix from B’ to B (rather than from 
B to B’), you would have obtained 


eet 42 = = 
(BiBi=|"> 3 | 


EXAMPLE 6 
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which reduces to 


[L, : r=) : : : | 


The transition matrix from B’ to B is 
ea 
P= : 
2, = 


You can verify that this is the inverse of the transition matrix found in Example 5 by 
multiplication: 


pe+=[> N23 2I-[o t= 


Coordinate Representation in General n-Dimensional Spaces 


One benefit of coordinate representation is that it enables you to represent vectors in an 
arbitrary n-dimensional space using the same notation used in R”. For instance, in Example 
6, note that the coordinate matrix of a vector in P; is a vector in R’. 


Coordinate Representation in P3 


SOLUTION 


EXAMPLE 7 


Find the coordinate matrix of p = 3x? — 2x” + 4 relative to the standard basis in P;, 
S = {1, x, x7, x7}. 

First write p as a linear combination of the basis vectors (in the order provided). 
p = A(1) + 0) + (—2)(2?) + 3@°) 

This tells you that the coordinate matrix of p relative to S is 


4 


0 
[pls = 9} 
3 


In the preceding section, you saw that it is sometimes convenient to represent n x | 
matrices as n-tuples. The next example presents some justification for this practice. 


Coordinate Representation in M; , 


Find the coordinate matrix of 
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relative to the standard basis in M, ,, 


1 0 
S= 4/0}, | 14, 
0) 0) 
SOLUTION Because X can be written as 
REMARK: In Section 6.2 you -1 
will learn more about the use X= 4} = 


of R” to represent an arbitrary 3 
n-dimensional vector space. 


0 
0 
1 


1 


0 


0 0 


(—1)/ 0] + 441] + 3/0}, 


0 1 


the coordinate matrix of X relative to S is 


—1 
LX]; = aa 
3 


Theorems 4.20 and 4.21 can be generalized to cover arbitrary n-dimensional spaces. This 
text, however, does not cover this. 


Sane aye Exercises 


In Exercises 1—6, you are provided with the coordinate matrix of x 
relative to a (nonstandard) basis B. Find the coordinate vector of x 
relative to the standard basis in R”. 


1. B= {(2, -1), (0, D}. [x], = [4 1? 

2. B= {(-1,4), 4, —1} [ly = [-2, 3]? 

3. B= {(, 0, 1), (1, 1, 0), (0, 1, 1)}, [x], = [2, 3, 1]? 

4. B = {(3,3,5), (3.4.3), (—3, 6, 2)}, Ely = [2, 0, 4]" 

5. B = {(0, 0, 0, 1), (0, 0, 1, 1), (0, 1, 1, 1), (1, 1, 1, 1)}, 
[x], = Ll, -2, 3, -1]" 

_ B= {(4, 0;.7; 3), (0, 5,:— 1, —1), (-3, 4, 23 1), (0, 1,5, 0)}, 
[x], = [-2, 3,4, 1]" 


Nn 


In Exercises 7—12, find the coordinate matrix of x in R” relative to 
the basis B. 


7. B = {(4,0), (0, 3)}, x = (12, 6) 
8. B = {(—6,7), (4, —3)}, x = (—26, 32) 
9. B = {(8, 11, 0), (7, 0, 10), (1, 4, 6)}, x = (3, 19, 2) 


10. B= {(3, 4, 1), (2.3, 0), (1,3, 2)}, x = (3, -3, 8) 


11. B = {(4, 3, 3), (—11, 0, 11), (0, 9, 2)}, x = (11, 18, —7) 

12. B= {(9, —3, 15, 4), (3, 0, 0, 1), (0, —5, 6, 8), (3, —4, 2, —3)}, 
x = (0, —20, 7, 15) 

In Exercises 13-18, find the transition matrix from B to B’ by hand. 

13. B = {(1, 0), (0, 1)}, B’ = {(2, 4), (1, 3)} 

14. B = {(1, 0), (0, 1)}, B’ = {(1, 1), (5, 6)} 

15. B = {(2, 4), (-1, 3)}, B’ = {(, 0), (0, 1)} 

16. B = {(1, 1), (1, 0)}, B’ = {(1, 0), (0, 1)} 

17. B = {(1, 0, 0), (0, 1, 0), (0, 0, 1)}, 

B’ = {(1, 0, 0), (0, 2, 8), (6, 0, 12)} 

B = {(1, 0, 0), (0, 1, 0), (0, 0, 1)}, 

B’ = {(1, 3, —1), (2, 7, —4), (2, 9, —7)} 


18. 


49) In Exercises 19-28, use a graphing utility or computer software 


program with matrix capabilities to find the transition matrix from 
Bto B’. 


19. B = {(2, 5), (1, 2)}, B’ = {(2, 1), (-1, 2)} 
20. B = {(—2, 1), (3, 2)}, B’ = {(1, 2), (-1, 0)} 


21. B = {(1, 3, 3), 1, 5, 6), (1. 4, 5)}, 

B’ = {(1, 0, 0), (0, 1, 0), (0, 0, 1)} 

B = {(2, —1, 4), (0, 2, 1), (—3, 2, 1)}, 
B’ = {(1, 0, 0), (0, 1, 0), (0, 0, 1)} 

B = {(1, 2, 4), (-1, 2, 0), (2, 4, 0)}, 
B’ = {(0, 2, 1), (—2, 1, 0), , 1, 1)} 
B = {(3, 2, 1), (1, 1, 2), (1, 2, 0)}, 
B’= {(1, 1, —1), (0, 1, 2), (—1, 4, 0)} 


22. 


23. 


24. 


25. B = {(1, 0, 0, 0), (0, 1, 0, 0), (0, 0, 1, 0), (0, 0, 0, 1)}, 
B’ = {(1, 3, 2, —1), (—2, —5, —5, 4), (-1, —2, —2, 4), 
(—2, —3, —5, 11)} 
26. B = {(1, 1, 1, 1), (0, 1, 1, 1), (0, 0, 1, 1), (0, 0, 0, 1)}, 


B’ = {(1, 0, 0, 0), (0, 1, 0, 0), (0, 0, 1, 0), (0, 0, 0, 1)} 


27. B = {(1, 0, 0, 0, 0), (0, 1, 0, 0, 0), (0, 0, 1, 0, 0), 
(0, 0, 0, 1, 0), (0, 0, 0, 0, 1) }, 
B’ = {(1, 2, 4, —1, 2), (—2, —3, 4, 2, 1), (0, 1, 2, —2, 1), 
(0, 1, 2, 2, 1), (1, —1, 0, 1, 2)} 
28. B = {(1, 0, 0, 0, 0), (0, 1, 0, 0, 0), (0, 0, 1, 0, 0), 


(0, 0, 0, 1, 0), (0, 0, 0, 0, 1)}, 
B’ = {(2, 4, —2, 1, 0), (3, —1, 0, 1, 2), (0, 0, —2, 4, 5), 
(2, -1, 2, 1, 1), (0, 1, 2, —3, 1)} 
In Exercises 29-32, use Theorem 4.21 to (a) find the transition 
matrix from B to B’, (b) find the transition matrix from B’ to B, 


(c) verify that the two transition matrices are inverses of each other, 
and (d) find [x], when provided with [x],.. 


29. B = {(1, 3), (—2, —2)}, 


ell 


30. B = {(2, —2), (6, 3)}, 


re-[.7] 


31. B = {(1, 0, 2), (0, 1, 3), (1, 1, Df, 
B’ = {(2, 1, 1), (1, 0, 0), (0, 2, 1)}, 
1 


[Ix]p =| 2 
=] 


Pah 12, 0.44} 


B’ = {(1, 1), (32, 31)}, 
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32. B = {(1, 1, 1), (1, -1, 1), (0, 0, 1}, 
B’ = {(2, 2, 0), (0, 1, 1), (1, 0, 1}, 


2 
[x], = 13 
1 


In Exercises 33 and 34, use a graphing utility with matrix capabili- 
ties to (a) find the transition matrix from B to B’, (b) find the 
transition matrix from B’ to B, (c) verify that the two transition 
matrices are inverses of one another, and (d) find [x], when 
provided with [x],.. 


33. B= {(4, 2, —4), (6, —5, —6), (2, 
B’ = {(1, 0, 4), (4, 2, 8), (2,5, —2)}, 
1 


[x], =|-1 
2 


1, 8)}, 


34. B = {(1, 3, 4), (2, —5, 2), (—4, 2, —6)}, 
B= {(1,.2, —2), (4, 1, -4), (—2, 5, 8)}, 
-1 
[x], = 0 
2 
In Exercises 35-38, find the coordinate matrix of p relative to the 
standard basis in P,. 
35. p=x? + 11x+4 
37. p= —2x° + 5x4+ 1 


36. p = 3x7 + 114x + 13 
38. p = 4x? — 3x — 2 


In Exercises 39-42, find the coordinate matrix of X relative to the 
standard basis in M;,. 


0 2 

39. X =| 3 40. X=|-1 
2 4 

1 1 

41.X=| 2 42.x=| 0 
-1 ~4 


True or False? In Exercises 43 and 44, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, 
provide an example that shows the statement is not true in all cases 
or cite an appropriate statement from the text. 


43. (a) If P is the transition matrix from a basis B to B’, then the 


equation P[x],, = [x], represents the change of basis from 
BtoB’. 
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(b) If B is the standard basis in R”, then the transition matrix 46. Let P be the transition matrix from B” to B’, and let Q be the 


from B to B’is P-! = (B’)“!. 


44, (a) If P is the transition matrix used to perform a change of 


transition matrix from B’ to B. What is the transition matrix 
from B to B”? 


basis from B’ to B, then P~! is the transition matrix from B 47. Writing Let B and B’ be two bases for the vector space R”. 


to B’. 


(b) To perform the change of basis from a nonstandard basis 


Discuss the nature of the transition matrix from B to B’ if one 
of the bases is the standard basis. 


B’ to the standard basis B, the transition matrix P~! is 48. Writing Is it possible for a transition matrix to equal the iden- 


simply B. 


tity matrix? Illustrate your answer with appropriate examples. 


45. Let P be the transition matrix from B” to B’, and let Q be the 
transition matrix from B’ to B. What is the transition matrix 


from B” to B? 


EXAMPLE 1 


4.8 | Applications of Vector Spaces 


Linear Differential Equations (Calculus) 


A linear differential equation of order 1 is of the form 


y + g,_ ay" +--+ + gy’ + go@)y = fQ), 


where go, 21,. - -»%,— , and f are functions of x with a common domain. If f(x) = 0, the 
equation is homogeneous. Otherwise it is nonhomogeneous. A function y is called a 
solution of the linear differential equation if the equation is satisfied when y and its first 
n derivatives are substituted into the equation. 


A Second-Order Linear Differential Equation 


SOLUTION 


Show that both y, = e* and y, = e ~* are solutions of the second-order linear differential 
equation y” — y = 0. 


For the function y, = e*, you have y,’ = e* and y,” = e*. So, 


Wm ye e* ee? = 0, 
and y, = e* is a solution of the differential equation. Similarly, for y, = e~*, you have 
y,’=-e* and y,”=e7 


This implies that 


a hye ae So 


So, y, = e “is also a solution of the linear differential equation. 


There are two important observations you can make about Example |. The first is that 
in the vector space C”(— oo, 00) of all twice differentiable functions defined on the entire 


Solutions of a Linear 
Homogeneous Differential 
Equation 


REMARK: The solution y = 
Ciy, + Cyy, +++ ++ Cy, is 
called the general solution of 
the given differential equation. 


Definition of the 
Wronskian of a Set 
of Functions 
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real line, the two solutions y, = e* and y, = e “ are linearly independent. This means that 
the only solution of 


Cy, + Cyy, = 0 


that is valid for all x is C; = C, = 0. The second observation is that every linear combina- 
tion of y, and y, is also a solution of the linear differential equation. To see this, let 
y = Cyy, + Cyy>. Then 


y = Cie’ + Cye~* 
y= Ce = Cee 
y” = Cye* + Coe™. 
Substituting into the differential equation y” — y = 0 produces 
yo —7= (Ces Ce —(Ge + Ce) = 0. 


So, y = C,e* + C,e~ is a solution. 
These two observations are generalized in the next theorem, which is stated without 
proof. 


Every nth-order linear homogeneous differential equation 
Be my 9h eo Oh Mma -s(0)) dec Ae) Veal) 


has n linearly independent solutions. Moreover, if {y,, y>,. . -,Y,} is a set of linearly 
independent solutions, then every solution is of the form 


YP = (Cipyy ar Cay are 8 ar Coy. 


where C,, C;,. . ., and C,, are real numbers. 


In light of the preceding theorem, you can see the importance of being able to determine 
whether a set of solutions is linearly independent. Before describing a way of testing for 
linear independence, you are provided with a preliminary definition. 


Let {y,, y>,- - -,y,} be a set of functions, each of which has n — | derivatives on an 
interval J. The determinant 


MAL yp, toe Yn 

yy’ yo" ¢ 0 2 a 

Wp Yn. 2 4 ¥,) = : ; : 
ey ee 


is called the Wronskian of the given set of functions. 
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EXAMPLE 2 


REMARK: The Wronskian of a set of functions is named after the Polish mathematician 
Josef Maria Wronski (1778-1853). 


Finding the Wronskian of a Set of Functions 


Wronskian Test for 
Linear Independence 


EXAMPLE 3 


(a) The Wronskian of the set {1 — x, 1 + x,2 — x} is 


h=—x« lta 2—x 
W= —1 1 —-1/=0. 
0 0 0 


(b) The Wronskian of the set {x, x7, x*} is 


x x2 
W=]1 2x 3x?) = 2x3. 
0 2 6x 


The Wronskian in part (a) of Example 2 is said to be identically equal to zero, because 
it is zero for any value of x. The Wronskian in part (b) is not identically equal to zero 
because values of x exist for which this Wronskian is nonzero. 

The next theorem shows how the Wronskian of a set of functions can be used to test for 
linear independence. 


REMARK: This test does not apply to an arbitrary set of functions. Each of the functions 
yy, Yo,+ » -, and y, must be a solution of the same linear homogeneous differential equa- 
tion of order n. 


Testing a Set of Solutions for Linear Independence 


SOLUTION 


Determine whether {1, cos x, sin x} is a set of linearly independent solutions of the linear 
homogeneous differential equation 
y” + y’ = 0) 


Begin by observing that each of the functions is a solution of y” + y’ = 0. (Try checking 
this.) Next, testing for linear independence produces the Wronskian of the three functions, as 
follows. 
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1 cos x sin x 
W=]|0 -—sinx cos x 
QO -cosx —sinx 


= sin? x + cos*x = | 
Because W is not identically equal to zero, you can conclude that the set {1, cos x, sin x} is 
linearly independent. Moreover, because this set consists of three linearly independent 
solutions of a third-order linear homogeneous differential equation, you can conclude that 
the general solution is y = C, + C,cos x + C; sin x. 


EXAMPLE 4 Testing a Set of Solutions for Linear Independence 


Determine whether {e*, xe*, (x + 1)e*} is a set of linearly independent solutions of the 
linear homogeneous differential equation 


ay? a 3y” + 3y’ -y= 0. 


SOLUTION As in Example 3, begin by verifying that each of the functions is actually a solution of 
y” — 3y” + 3y’ — y = 0. (This verification is left to you.) Testing for linear independence 
produces the Wronskian of the three functions as follows. 


e* xe* (x + l)e* 
W=leX (x+ Der (x4 2)e| = 
eX (x +2)e* (x + 3)e* 


So, the set {e*, xe*, (x + 1)e*} is linearly dependent. 


In Example 4, the Wronskian was used to determine that the set 
{e*, xe*, (x + l)e*} 


is linearly dependent. Another way to determine the linear dependence of this set is to 
observe that the third function is a linear combination of the first two. That is, 


(x + lex = e* + xe*. 


Try showing that the different set {e*, xe*, x2e*} forms a linearly independent set of solu- 
tions of the differential equation 


y” —_ 3y” + 3y’ = y = 0. 
Conic Sections and Rotation 


Every conic section in the xy-plane has an equation of the form 


ax? + bxy + cy? + dx + ey +f=0. 


266 8 Chapter 4 Vector Spaces 


Standard Forms of 
Equations of Conics 


Identifying the graph of this equation is fairly simple as long as b, the coefficient of the 
xy-term, is zero. In such cases the conic axes are parallel to the coordinate axes, and the 
identification is accomplished by writing the equation in standard (completed square) form. 
The standard forms of the equations of the four basic conics are provided in the next sum- 
mary. For circles, ellipses, and hyperbolas, the point (/, k) is the center. For parabolas, the 
point (A, k) is the vertex. 


(= moins: (= DP ++ Gy = AP = 7 
(2a = major axis length, 26 = minor axis length): 


(x-h)?  (y-k? = Dy, @-h? (-b? =i 


y 
a a B = A B oF a2 
2B 20 
> xX > xX 


(2a = transverse axis length, 28 = minor axis length): 


Y («x=h) Ges Ye «=m | 
ane Dae Wine i = 
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Standard Forms of 
Equations of Conics (cont.) 


EXAMPLE 5| Identifying Conic Sections 


(a) The standard form of x7 — 2x + 4y — 3 = Ois (x — 1)? = 4(—1)(y — 1). The graph 
of this equation is a parabola with the vertex at (h, k) = (1, 1). The axis of the parabola 
is vertical. Because p = — 1, the focus is the point (1, 0). Finally, because the focus lies 
below the vertex, the parabola opens downward, as shown in Figure 4.20(a). 


(b) The standard form of x? + 4y? + 6x — 8y + 9 = Ois 
+ 2. = 2 
(+3)? =F, 
4 1 
The graph of this equation is an ellipse with its center at (h, k) = (—3, 1). The major 
axis is horizontal, and its length is 2a = 4. The length of the minor axis is 28 = 2. The 
vertices of this ellipse occur at (— 5, 1) and (— 1, 1), and the endpoints of the minor axis 
occur at (—3, 2) and (—3, 0), as shown in Figure 4.20(b). 
a y b y 
(a) 1 a0 (b) : 


(1, 0) 
+ 


Focus 2 


ae (-3, 2) 


3 4 3 2 a o, 
2 fy—4)2 
@—12=4C1)y- 1) Gay, 2 i 


Figure 4.20 
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(—sin 0, cos 6). 


3 ee 
NZ 
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y 
A (cos 0, sin 0) 


1 
\ 
A 


rae 


- 
- 


Figure 4.21 
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‘1, 0) 


ot 
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EXAMPLE 6 


The equations of the conics in Example 5 have no xy-term. Consequently, the axes of the 
corresponding conics are parallel to the coordinate axes. For second-degree polynomial 
equations that have an xy-term, the axes of the corresponding conics are not parallel 
to the coordinate axes. In such cases it is helpful to rotate the standard axes to form a 
new x’-axis and y’-axis. The required rotation angle @ (measured counterclockwise) is 
cot 20 = (a — c)/b. With this rotation, the standard basis in the plane 


B = {(1, 0), (0, 1)} 
is rotated to form the new basis 
B' = {(cos @, sin 6), (—sin 0, cos 6)}, 


as shown in Figure 4.21. 
To find the coordinates of a point (x, y) relative to this new basis, you can use a transi- 
tion matrix, as demonstrated in Example 6. 


A Transition Matrix for Rotation in the Plane 


SOLUTION 


Find the coordinates of a point (x, y) in R? relative to the basis 
B' = {(cos 6, sin 6), (—sin 6, cos 6)}. 

By Theorem 4.21 you have 
[B’: B]= 


cos 8 


-—snd : 1 0 
sin 0 


coed : 0 1] 


Because B is the standard basis in R*, P~! is represented by (B’)~!. You can use Theorem 
3.10 to find (B’)~!. This results in 


: 1 0 : cosé siné 
Ee P| = : 
[ | 0 1 —sin @ cos sl 
By letting [x’, y’]’ be the coordinates of (x, y) relative to B’, you can use the transition 
matrix P~' as follows. 


cos @ sin | Hl _ | 
—sin@ cos 6} Ly y’ 
The x’- and y’-coordinates are 


= xcos@+y sin@é 


x’ 
y’ = —x sin 6 + ycos 6. 


The last two equations in Example 6 give the x’y”-coordinates in terms of the 
xy-coordinates. To perform a rotation of axes for a second-degree polynomial equation, it is 
helpful to express the xy-coordinates in terms of the x’y coordinates. To do this, solve the 
last two equations in Example 6 for x and y to obtain 


x =x’cos@— y’siné and y = x’sin 0+ y’cos 0. 


Rotation of Axes 


EXAMPLE 7 
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Substituting these expressions for x and y into the given second-degree equation produces 
a second-degree polynomial equation in x’ and y’ that has no x“y’-term. 


The second-degree equation ax” + bxy + cy* + dx + ey + f = 0 can be written in the 
form 


CAP ECP ae? +e Oy" EP =O 
by rotating the coordinate axes counterclockwise through the angle 6, where 6 is defined by 


a= € : : : we 
cot 26 = aye The coefficients of the new equation are obtained from the substitutions 


x = x’cos @— y’ sin @ 


y =x’ sin + y’cos @. 


REMARK: When you solve for sin @ and cos 6, the trigonometric identity 
cot? 6-1 


cot 20 = ————— is often useful. 
2 cot 0 


Example 7 demonstrates how to identify the graph of a second-degree polynomial by 
rotating the coordinate axes. 


Rotation of a Conic Section 


SOLUTION 


Perform a rotation of axes to eliminate the xy-term in 
5x2 — 6xy + Sy? + 14/2x — 2\/2y + 18 = 0, 
and sketch the graph of the resulting equation in the x ‘y -plane. 
The angle of rotation is represented by 
a=-¢ 39=5 
cot 26 b = 0. 
This implies that 6 = 7/4. So, 


d cos 0 


1 
Se aay 5 an 


By substituting 
, f) fis fA) 1 ( , 4) 
=x’cosé—y’sin@= - 
a : a 
and 


i 
y =x’sin@+ y’cos0= a +y’ 


270 3=Chapter 4 Vector Spaces 


(+32 =D 
ee aes | 


= Pd 
=?) y 
7 -3 
(-3V2, -2V2) ; 
Figure 4.22 


into the original equation and simplifying, you obtain 
(x’)? + 4(y’)? + 6x’ — 8y’+9=0. 
Finally, by completing the square, you find the standard form of this equation to be 


(+3? G’- 1 _&’ +3? GIP 
2? 1? 4 1 


1, 


which is the equation of an ellipse, as shown in Figure 4.22. 


In Example 7 the new (rotated) basis for R? is 


1 1 1 1 
B' = ? 5 > ? 
( J2 Za) ( v2 -a)| 
and the coordinates of the vertices of the ellipse relative to B’ are [—5, 1]? and [—1, 1]”. 


To find the coordinates of the vertices relative to the standard basis B = {(1, 0), (0, 1)}, 
use the equations 


a(x’ y’) 
x= HK 
Ja - 
and 


y Wis + y’) 
to obtain (-32, ~2,/2) and (— JD. 0), as shown in Figure 4.22. 


SANs Exercises 


Linear Differential Equations (Calculus) 


In Exercises 1—8, determine which functions are solutions of the 


linear differential equation. 


ly”’+y=0 

(a) e* (b) sin x (c) cos x 
2. y” + 3y”+ 3y’+y=0 

(a) x (b) e* (c) e* 
3. y” + 4y’+ 4y =0 

(a) e~?* — (b) xe7>* (c) x2e~>* 
4. y”—2y”+ y"=0 

(a) 1 (b) x (c) x? 


5. x?y”— 2y =0 


@y=z Wy=P }y=e" WMy=e* 
6. xy” + 2y’=0 
1 
(d) sinx — cos x (a) y=x (b) y= . (c)y=xe* (d) y= xe™ 
7. y”"—y’— 2’ =0 
(d) xe™* (a) y = xe* = (b) y = 2e* (c) y = 2e-2 (d) y = xe™* 
8. y’ — 2xy = 0 
(d) (x + 2)e™™ (a) y =3e" 3 =(b) y= xe" (ce) y=xet = (d) y= xe™* 


(d) e* 
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In Exercises 9-16, find the Wronskian for the set of functions. Conic Sections and Rotation 
9. fe*,e*} 10. {ee} In Exercises 35-52, identify and sketch the graph. 
11. {x, sin x, cos x} 12. {x, —sin x, cos x} 4550 46. oe SD 
Pie ae eee Mae set 37. x2 + 4y? — 16 =0 38. 5x2 + 3y? — 15 =0 
15. {1, e*, e>*} 16. {x2, e*, x2e*} 
i _ a ae 
In Exercises 17-24, test the given set of solutions for linear 39. 9 16 I= 40. 16. 25 ! 
independence. 42-2 oe 
Differential Equation Solutions p ; - 
17. y"+y=0 {sin x, cos x} 42. y" — by — 4x + 21 = 
18. y"+ dy’ + Ay =0 fe 2%, xe~>*} 43. 9x? 25y? 36x SOy + 61 =0 
. ; 7 ey = 
19. yu+ Ay” + Ay’ =0 fer, xe 2%, (2x + De} 44, 4x y 8& +3=0 
2 1 1 _ 
20. yu+ y’ =(0 {1, sin X, COS x} 45. 9x y? 54x 4 10y + 55 0 
2 2 = 
21. y”+ y’=0 {2, -1 + 2 sin x, 1 + sin x} 46. 4y* — 20° — dy — 8x — 15 = 0 
2 4 2. i = 
22. yl” 3y” 3y’ y= 0 fer, xe*, xe} 47, x° + 4y 4x 32y T 64 0 
23. yl” 3y” 3y’ y= 0 {e-*, xe*, ere xe~*} 48. 4y? t 4x2 24x + 35 =0 
24. y"— 2y ma y= 0 {1, x, ex, xe*} 49. 2x? y? 4x 10y 22 =0 
; ; 50. 40° — y? + 4x + 2y-1=0 
25. Sa solution of the differential equation from 5 2 kde ey 0 
52. y2 + 8x + 6y + 25 = 
26. Find the general solution of the differential equation from . ee ey aa 
Exercise 18. In Exercises 53-62, perform a rotation of axes to eliminate the 
27. Find the general solution of the differential equation from xy-term, and sketch the graph of the conic. 
reales 53. xy + 1 =0 54, xy -2=0 
28. oe solution of the differential equation from 55. 4x2 + 2xy + 4y2 — 15 =0 
: 56. x7 + 2xy + y? — 8x + By =0 
29. ae os ei . bs a ax + C, sin ax is the general solution of 57, 5x2 — Ixy + Sy? — 24 =0 
: , ‘ 2 2 = 
30. Prove that the set {e“, e°*} is linearly independent if and only if pores on oy ai 
a¢b. 59, 13x? + 6./3xy + Ty? - 16=0 
31. Prove that the set {e“*, xe} is linearly independent. 60. 3x? 2/3xy + y? + 2x 4 2/3 y=0 
32. Prove that the set {e“ cos bx, e“ sin bx}, where b ¥ 0, is 61. 2+ 2 /3xy b ay? 2/3x 4 2y + 16 =0 


linearly independent. 


oe : . 62. 7x2 — 2\/3xy + 5y? = 16 
33. Writing Is the sum of two solutions of a nonhomogeneous lin- . 


ear differential equation also a solution? Explain your answer. In Exercises 63-66, perform a rotation of axes to eliminate the 


_ , . xy-term, and sketch the graph of the “degenerate” conic. 
34. Writing Is the scalar multiple of a solution of a nonhomoge- 


neous linear differential equation also a solution? Explain your 63. 0° — 2xy + y? = 64. 5x? — 2xy + Sy? =0 
answer. 65. x? + 2xyv + y?-1=0 66. x° — 10xy + y? = 0 
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67. Prove that a rotation of @ = 77/4 will eliminate the xy-term from 
the equation 
2 


ax? + bxy + ay? + dx + ey + f= 0. 
68. Prove that a rotation of 6, where cot 20 = (a — c)/b, will elim- 
inate the xy-term from the equation 


2, 


ax? + bxy + cy? + dx t+ ey + f=0. 


69. For the equation ax? + bxy + cy? = 0, define the matrix A as 
Ax | a ya 
b/2 ¢ 
Prove that if |A] # 0, then the graph of ax? + bxy + cy? = 0 is 
two intersecting lines. 
70. For the equation in Exercise 69, define the matrix A as 
|A| = 0, and describe the graph of ax? + bxy + cy” = 0. 


Vala Review Exercises 


In Exercises 1—4, find (a) u + v, (b) 2v, (c) u — v, and (d) 3u — 2v. 
1. u = (-1,2,3), v = (1,0, 2) 

2. u=(-1,2,1), v= (0,1,1) 

3. u = (3, -1, 2,3), v = (0, 2,2, 1) 

4. u = (0,1, -1,2), v = (1,0, 0, 2) 

In Exercises 5-8, solve for x provided that u = (1, —1, 2), 
v = (0, 2, 3), and w = (0, 1, 1). 

5. 2x -—u+3v+w=0 6. 3x + 2u—v + 2w=0 

7. 5u— 2x =3v +w 8. 2u + 3x = 2v—w 


In Exercises 9-12, write v as a linear combination of u,, u,, and u,, 
if possible. 


XV = (3, 0, 6), u= (, 1, 2), u, = (2, 4, —2), 
u, = d, 2, —4) 
10. v = (4,4,5), uy =(1,2,3), uw, = (2,0, 1), 
u, = (1, 0, 0) 
11. v = (1, 2,3,5), u, = (1,2,3,4), u, = (-1, —2, —3, 4), 
u, = (0,0, 1, 1) 
12. v = (4, -13,-5, -4), u, = (1, -2, 1, 1), 
u, = (—1, 2, 3, 2), uz; = (0, —1, -1, -1) 


In Exercises 13—16, describe the zero vector and the additive inverse 
of a vector in the vector space. 


13. M3, 14. P, 15. R° 16. M,, 


In Exercises 17-24, determine whether W is a subspace of the 
vector space. 

17. W = {(x, y): x = 2y}, V= R? 

18. W={(x,y):x-y=1}, V=R? 

19. W = {(x, y): y = ax, ais an integer}, V = R? 

20. W = {(x, y): y = ax?}, V= R? 


21. W = {(x, 2x, 3x): xis areal number}, V = R? 

22. W= {(x, y,z):x 2 0}, V=R 

23. W = (f:f(0) = -1}, V=C[-1,1] 

24. W = {f:f(-—1) = 0}, V=C[-1, 1] 

25. Which of the subsets of R? is a subspace of R?? 
(a) W = {(x,, X, %3): x47 + x5 + 3 = 0} 
(b) W = {(xy, xy, x3): x7 + x5 + x4 = 1} 

26. Which of the subsets of R? is a subspace of R3? 
(a) W = {(x,, 5,3): x, + x, + x, = 0} 
(b) W = {(Xy, Xp, X3)2 x, +X + x, = 1} 


In Exercises 27—32, determine whether S (a) spans R°, (b) is linearly 
independent, and (c) is a basis for R°. 


27. S = {(1, —5, 4), (11, 6, —1), (2, 3, 5)} 

28. S = {(4, 0, 1), (0, —3, 2), (5, 10, 0)} 

29. s = {(-3,3, -1), 6,2, 3), (-4, 6, —8)} 

30. S = {(2,0, 1), (2, -1, 1), (4, 2, 0)} 

31. S = {(1, 0, 0), (0, 1, 0), (0, 0, 1), (—1, 2, —3)} 
32. S = {(1, 0, 0), (0, 1, 0), (0, 0, 1), (2, —1, 0)} 


33. Determine whether § = {1 
basis for P3. 


t, 2t + 37,2 — 28,2 + Bhisa 
34. Determine whether S = {1, t, 1 + 7} is a basis for P.. 


In Exercises 35 and 36, determine whether the set is a basis for 
Mj >». 


ssf 4S IR IG 
«I 9G ab i 


In Exercises 37—40, find (a) a basis for and (b) the dimension of the 
solution space of the homogeneous system of equations. 


37. 2x, + 4x, + 3x; 6x, = 0 
X, + 2X, + 2x5 5x, = 0 
3x, + 6x, + 5x3 — 11x, =0 


38. 3x, + 8x, + 2x, + 3x, = 0 


4x, + 6x, + 2x, =O 


3x, + 4x, Xe = 3X, = 0 

39. X= 3% + Ht x, = 0 
2x) Xy x3 + 2x, =0 

xX, + 4x, — 2x3 x,=0 

5x; — 8x, + 2x, + 5x, = 0 


40 x, + 2x, X3 2x, =0 
2x, + 2x, X3 4x, =0 
3x, + 2x, + 2x, 5x, = 0 
3x, + 8x, + 5x3 + 17x, = 0 


In Exercises 41—46, find a basis for the solution space of Ax = 0. 
Then verify that rank(A) + nullity(A) = n. 


at. a=| 2 i 
-10 16 


aa-[) 7] 
3 2 
2-3 -6 -4 
4.A=|1 5 -3 I 
2 7 -6 16 
1 0-2 0 
44.A4=| 4 -2 4 -2 
2 0 1 3 
i 2 2 
4 -1 -1 
45. A = : 
-1 3 10 
1 2 0 
i 2 ft 2 
@a2|2 2 © 3 
2 3 0 2 
1 2 6 1 
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In Exercises 47—52, find (a) the rank and (b) a basis for the row 
space of the matrix. 


1 2 4 =f A 
47.|-4 3 48./1 5 6 
6 1 1 16 14 
4.[1 -4 0 4] 50.[1 2 —-1] 
7 DY 2 1 2 0 
51./ 4 1 6 52.}/-1 4 1 
-1 16 14 0 1 3 


In Exercises 53—58, find the coordinate matrix of x relative to the 
standard basis. 


53. B= {d, 1), (-1, 1)}, [x], = [3, 5|" 

54. B = {(2,0),(3,3)}, [xp = [1 1" 

55. B = {(3,4), 1,0}, (xl, = [4] 

56. B = {(4, 2), 0, - 1)}, [x], = [2, 1]? 

57. B = {(1,0, 0), (, 1, 0), (0, 1, 1)}, [x], = [2, 0, - 1]? 
58. B= {(, 0, 1), (0, 1, 0), (0, 1, 1)}, [x], = [4, 0, 2" 


In Exercises 59—64, find the coordinate matrix of x relative to the 
(nonstandard) basis for R”. 


59. B’ = {(5,0), (0, —8)}, x = (2,2) 
60. B’ = {(1, 1), (0, -2)}, x= (2,-1) 
61. B’ = {(1, 2, 3), (1, 2, 0), (0, —6, 2)}, x = (3, —3, 0) 
62. B’ = {(1, 0, 0), (0, 1,0), (1,1, )}, x = (4, -2, 9) 
63. B’ = {(9, —3, 15, 4), (—3, 0, 0, —1), (0, —5, 6, 8), 
(—3,4, -2,3)}, x = (21, —5, 43, 14) 
64. B’ = {(1, 1,2, 1), (1, 1, —4, 3), (1, 2, 0, 3), 
(1,2, -2,0)}, x = (5, 3, —6, 2) 


In Exercises 65—68, find the coordinate matrix of x relative to the 
basis B’. 


65. 8={(0,1),(-1,)} B= 10,1), 0,21, 


[x], = [3, -3]” 
66. B = {(1,0),(1,-D}, B’ = {(1, 1), (1, -D}, 
[x], = [2, -2]" 


67. B = {(1, 0, 0), (, 1,0), (, 1, Df}, 

B’ = {(0, 0, 1), (0,1, ),0,1, D0}, Ex], =[- 1,2, -3]" 
68. B = {(1, 1, -1), (1, 1, 0), 1, —1, 0)}, 

B’ = {(1, —1, 2), (2, 2, —1), (2,2, 2)}, Ex], = [2, 2, -1]” 
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In Exercises 69—72, find the transition matrix from B to B’. 


69. B = {(1, -1), 3, D}, B’ = {C, 0), (0, 1)} 
70. B = {(1, -1), 3, 1)}, B’ = {(1, 2), (—1, 0)} 
71. B = {(1, 0, 0), (0, 1, 0), (0, 0, 1)}, 

B’= {(0, 0, 1), (0, 1, 0), (1, 0, 0)} 
72. B = {(1, 1, 1), (, 1, 0), C1, 0, 0)}, 

B’= {(1, 2, 3), (0, 1, 0), (1, 0, 1)} 


73. Let W be the subspace of P, (all third-degree polynomials) such 
that p(0) = 0, and let U be the subspace of all polynomials such 
that p(1) = 0. Find a basis for W, a basis for U, and a basis for 
their intersection WN U. 


74. Calculus Let V = C’(—co, 00), the vector space of all contin- 
uously differentiable functions on the real line. 


(a) Prove that W = {f: f’ = 3f } is a subspace of V. 
(b) Prove that U = {f:f’ =f + 1} is not a subspace of V. 


75. Writing Let B= {p,(x), po(x),. - -. p(X), Pyii)} be a 
basis for P,. Must B contain a polynomial of each degree 


0,1,2,. . .,? Explain your reasoning. 
76. Let A and B be n x n matrices with A # O and B # O. Prove 
that if A is symmetric and B is skew-symmetric (B7 = —B), 


then {A, B} is a linearly independent set. 

77. Let V = Ps and consider the set W of all polynomials of the 
form (x3 + x)p(x), where p(x) is in P,. Is Wa subspace of V? 
Prove your answer. 

78. Let v,, V,, and v; be three linearly independent vectors in a 
vector space V. Is the set {v, — V,, V, — V3, V3; — V,} linearly 
dependent or linearly independent? 

79. Let A be ann x n square matrix. Prove that the row vectors of 
A are linearly dependent if and only if the column vectors of A 
are linearly dependent. 


80. Let A be ann x n square matrix, and let A be a scalar. Prove that 
the set 


S = {x: Ax = Ax} 


is a subspace of R”. Determine the dimension of S if A = 3 and 


5) 1 0 
A=|0 3 0}. 
0 0 1 


81. Let f(x) = x and g(x) = |2I. 
(a) Show that f and g are linearly independent in C[—1, 1]. 
(b) Show that f and g are linearly dependent in C[0, 1]. 


82. Given a set of functions, describe how its domain can influence 
whether the set is linearly independent or dependent. 


True or False? In Exercises 83-86, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


83. (a) The standard operations in R” are vector addition and scalar 
multiplication. 


(b) The additive inverse of a vector is not unique. 
(c) A vector space consists of four entities: a set of vectors, a set 
of scalars, and two operations. 
84. (a) The set W = {(0, x?, x3): x? and x? are real numbers} is a 
subspace of R?. 
(b) A linearly independent spanning set S is called a basis of a 
vector space V. 
(c) If A is an invertible n x n matrix, then the n row vectors of 
A are linearly dependent. 
85. (a) The set of all n-tuples is called n-space and is denoted 
by R”. 
(b) The additive identity of a vector is not unique. 
(c) Once a theorem has been proved for an abstract vector 


space, you need not give separate proofs for n-tuples, 
matrices, and polynomials. 


86. (a) The set of points on the line represented by x + y = Oisa 
subspace of R?. 


(b) A set of vectors S = {v,, V5,. . .,V,,} in a vector space V 
is linearly independent if the vector equation c,v, + 


CV, ++ + + + ,v,, = 0 has only the trivial solution. 


(c) Elementary row operations preserve the column space of the 
matrix A. 


Linear Differential Equations (Calculus) 


In Exercises 87-90, determine whether each function is a solution 
of the linear differential equation. 


87. y”— y’ — by = 0 


(a) e* (b) e?* (c) e ** (d) e~>* 
88. vy” -y=0 
(a) e* (b) e* (c) cos x (d) sin x 


89. y’ + 2y =0 


(a) 


e72x 


90. y” + 9y =0 


(a) sin 3x + cos 3x 


(c) 


sin 3x 


(b) xe72* 


(c) x2e-* (d) 2xe~?* 


(b) 3 sinx + 3 cosx 
(d) cos 3x 


In Exercises 91—94, find the Wronskian for the set of functions. 


91. {1,2 
93. {1, sin 2x, cos 2x} 


In Exercises 95-98, test the set of solutions for linear independence. 


x, e*} 


Differential Equation 


95. y” + by’ + Oy 

96. y” + 6y’ + Oy 

97. y” — 6y” + lly’ —- 6y =0 
98. y”+ 4y =0 


92. {1,x,2 + x} 


94. {x, sin? x, cos? x} 


Solutions 
{e~3*, xe~3*} 
{e~**, 3e7#*} 
fer, e%, ex — eX} 


{sin 2x, cos 2x} 
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Conic Sections and Rotation 


In Exercises 99-106, identify and sketch the graph of the equation. 


99. x? + y?—4x+ 2y-4=0 

100. 9x? + 9y? + 18x — 18y + 14 =0 
101. x? —y+2x-3=0 

102. 4x7 —- > + 8k —-6y + 4=0 
103. 2x7 — 20x —-y + 46 =0 

104. y — 4x -4=0 

105. 4x2 + y? + 32x + 4y + 63 =0 
106. 16x? + 25y? — 32x — 50y + 16 =0 


In Exercises 107-110, perform a rotation of axes to eliminate the 
xy-term, and sketch the graph of the conic. 

107. xy = 3 108. 9x? + 4xy + 9y? — 20 = 0 
109. 16x? — 24xy + 9y* — 60x — 80y + 100 = 0 

110. 7x2 + 6/3xy + 13y? — 16 =0 


GUN aides Projects 


1 Solutions of Linear Systems 


Write a short paragraph to answer each of the following questions about solutions of 
systems of linear equations. You should not perform any calculations, but instead base 
your explanations on the appropriate properties from the text. 


1. One solution of the homogeneous linear system 
x+2y+z+ 3w=0 


a 


+ w=0 


y-—z+2w=0 
is x= —2, y=—1, z=1, and w= 1. Explam why x =4, y = 2, 
z = —2, and w = —2 must also be a solution. Do not perform any row 


operations. 


2. The vectors x, and x, are solutions of the homogeneous linear system 
Ax = 0. Explain why the vector 2x, — 3x, must also be a solution. 
3. Consider the two systems represented by the augmented matrices. 


1 13) 
1 @ =f 
2 Ale ll 


3 1 1 =5" =9 
1 1 OG? ame) 
0 20S eal! eal 0 


If the first system is known to be consistent, explain why the second system 
is also consistent. Do not perform any row operations. 
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4. 


5) 


6. 


The vectors x, and x, are solutions of the linear system Ax = b. Is the 
vector 2x, — 3x, also a solution? Why or why not? 

The linear systems Ax = b, and Ax = b, are consistent. Is the system 
Ax = b, + b, necessarily consistent? Why or why not? 

Consider the linear system Ax = b. If the rank of A equals the rank of the 
augmented matrix for the system, explain why the system must be consistent. 
Contrast this to the case in which the rank of A is less than the rank of the 
augmented matrix. 


2. Direct Sum 


Let U and W be subspaces of the vector space V. You learned in Section 4.3 that the 
intersection UM W is also a subspace of V, whereas the union U U W is, in general, 
not a subspace. In this project you will explore the sum and direct sum of subspaces, 
focusing especially on their geometric interpretation in R”. 


Il 


Define the sum of the subspaces U and W as follows. 
U+W={u+w:uEU,weE WwW} 
Prove that U + Wis a subspace of V. 


. Consider the subspaces of V = R? listed below. 


U=iny.7— yy eR} 
WY = Ge, ©, 50) sae S IR} 
Z = 1,52) oe SR} 


Find U + W,U + Z,and W + Z. 


. If U and W are subspaces of V such that V = U + W and UN W = {0}, 


prove that every vector in V has a unique representation of the form u + w, 
where u is in U and w is in W. In this case, we say that V is the direct sum 
of U and W, and write 


V=UOW. Direct sum 


Which of the sums in part (2) of this project are direct sums? 


. Let V= U®W and suppose that {u,,u,,. . .,u,} is a basis for the 


subspace U and {w,, W>,. . ., W,,} is a basis for the subspace W. Prove that 
the set{u,,. . .,U,, Wj,. . ., W,,} is a basis for V. 


. Consider the subspaces of V = R? listed below. 


U = {(z,0, y) +x, y ] R} 
W = {(0, x, y): x, y © R} 
Show that R? = U + W. Is R° the direct sum of U and W? What are the 


dimensions of U, W, UM W, and U + W? In general, formulate a conjecture 
that relates the dimensions of U, W, UM W, and U + W. 


. Can you find two 2-dimensional subspaces of R? whose intersection is just 


the zero vector? Why or why not? 


Inner Product Spaces 


5.1 Length and Dot Product CHAPTER OBJECTIVES 
in R” 
5.2 Inner Product Spaces 
5.3 Orthonormal Bases: 
Gram-Schmidt Process 
5.4 Mathematical Models 
and Least Squares 
Analysis Determine whether a function defines an inner product on R", M,,,,, or P,,, and find the inner 
5.5 Applications of Inner product as defined for two vectors (u, v) in R”, M,,,, and P,,. 
Product Spaces 


@ Find the length of v, a vector u with the same length in the same direction as v, and a unit 
vector in the same or opposite direction as v. 


Find the distance between two vectors, the dot product, and the angle 6 between u and v. 
Verify the Cauchy-Schwarz Inequality, the Triangle Inequality, and the Pythagorean Theorem. 
Determine whether two vectors are orthogonal, parallel, or neither. 


Find the projection of a vector onto a vector or subspace. 

Determine whether a set of vectors in R" is orthogonal, orthonormal, or neither. 
Find the coordinates of x relative to the orthonormal basis R”. 

Use the Gram-Schmidt orthonormalization process. 

Find an orthonormal basis for the solution space of a homogeneous system. 


Determine whether subspaces are orthogonal and, if so, find the orthogonal complement of a 
subspace. 


Find the least squares solution of a system Ax = b. 
Find the cross product of two vectors u and v. 
Find the linear or quadratic least squares approximating function for a known function. 


Find the nth-order Fourier approximation for a known function. 


5.1) Length and Dot Product in R" 


Section 4.1 mentioned that vectors in the plane can be characterized as directed line 
segments having a certain /Jength and direction. In this section, R? will be used as a model 
for defining these and other geometric properties (such as distance and angle) of vectors in 
R". In the next section, these ideas will be extended to general vector spaces. 

You will begin by reviewing the definition of the length of a vector in R?. If v = (v,, v5) 
is a vector in the plane, then the length, or magnitude, of v, denoted by ||v]|, is defined as 


lvl = Vvt + v3. 
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This definition corresponds to the usual notion of length in Euclidean geometry. That is, the 
vector v is thought of as the hypotenuse of a right triangle whose sides have lengths of |v,| 
and |v,|, as shown in Figure 5.1. Applying the Pythagorean Theorem produces 


IIvIP = Iv? + [vs]? = vi + v3. 


Ilvoll 


lly, Il 


IlvIl= yp +v3 


Figure 5.1 


Using R? as a model, the length of a vector in R” is defined as follows. 


Definition of Length — The Jength, or magnitude, of a vector v = (v,,¥5,. . .. v,) in R” is given by 
of a Vector in R" 


lvl= VV +v+--- +2 


REMARK: The length of a vector is also called its norm. If ||v|| = 1, then the vector v is 
called a unit vector. 


Iv||=0. 


This definition shows that the length of a vector cannot be negative. That is, 
|v|| = 0 if and only if v is the zero vector 0. 


Moreover, 


Technolo gy You can use a graphing utility or computer software program to find the length, or norm, of a vector. 
Note For example, using a graphing utility, the length of the vector v = (2, —1, —2) can be found and 
may appear as follows. 


Verify the length of v in Example 1(a) on the next page. 


Figure 5.2 


EXAMPLE 1 


Section 5.1 Length and Dot Product in R" 


The Length of a Vector in R” 


THEOREM 5.1 
Length of a 
Scalar Multiple 


PROOF 


(a) In R°, the length of v = (0, —2, 1, 4, —2) is 
I|v|| = /02 + (—2)2 + 12 + 42 + (—2)? = 25 =5. 
(b) In R°, the length of v = (2/\/17, —2/ /17, 3/17) is 


In (Fa) + (al + Ga) = Vito 


Because its length is 1, v is a unit vector, as shown in Figure 5.2. 
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Each vector in the standard basis for R” has length | and is called a standard unit 
vector in R”. In physics and engineering it is common to denote the standard unit vectors 


in R2 and R° as follows. 


{i, j} = {(, 0), 0, 1)} 
and 


{i, j,k} = {(1, 0, 0), (0, 1, 0), (0, 0, 1)} 


Two nonzero vectors u and v in R” are parallel if one is a scalar multiple of the other— 
that is, u = cv. Moreover, if c > 0, then u and v have the same direction, and if c < 0, 
u and v have opposite directions. The next theorem gives a formula for finding the length 
of a scalar multiple of a vector. 


Because cv = (cv, Cv3,. . ., CV,), it follows that 
llevl] = (er, ev, . . -, evn) | 
= JMcv,? + (ev, ++ + (ov,P 
= JA + vt-- +4 v2) 
= |ce| V2 +4 4+---°4+ 7 


= lel [lvl 
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One important use of Theorem 5.1 is in finding a unit vector having the same direction 
as a given vector. The theorem below provides a procedure for doing this. 
THEOREM 5.2 — If vis a nonzero vector in R”, then the vector 
Unit Vector in the - 
Direction of v u iivil 
has length | and has the same direction as v. This vector u is called the unit vector in the 
direction of v. 
PROOF Because v is nonzero, you know ||v|| # 0. 1/||v|| is positive, and you can write u as a 
positive scalar multiple of v. 
(ra) 
u=|__]v 
lvl 
So, it follows that u has the same direction as v. Finally, u has length 1 because 
1 
Jul = |p| = paylv = 
Iv [lvl 
The process of finding the unit vector in the direction of v is called normalizing the 
vector v. This procedure is demonstrated in the next example. 
EXAMPLE 2 Finding a Unit Vector 
Find the unit vector in the direction of v = (3, —1, 2), and verify that this vector has length 1. 
SOLUTION — The unit vector in the direction of v is 
v .. _G,-1,2) 
lvl 32 + (—1)? + 22 
z G9) 
30 wiae* 
a ( 3 t 2 
; J14 S14 /147’ 
tile, 1 ye which is a unit vector because 
See ae 2 2 2 
<b JMGay+ (ay (ey tan 
V14 V14 V14 14 


bs 


Figure 5.3 


(See Figure 5.3.) 
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Technol ogy You can use a graphing utility or computer software program to find the unit vector for a given 
vector. For example, you can use a graphing utility to find the unit vector for v = (—3, 4), which 
may appear as: 


VECTOR EW unit UW 


Distance Between Two Vectors in R” 


To define the distance between two vectors in R”, R? will be used as the model. The 
Distance Formula from analytic geometry tells you that the distance d between two points 
in the plane, (u,, u) and (vj, Vv), is 


d=(q =? Sw — wv). 


In vector terminology, this distance can be viewed as the length of u — v, where u = 
(u,, u>) and v = (v,, v3), as shown in Figure 5.4. That is, 
Olga Taussky-Todd 


_ — = 2. = 2: 
(1906-1995) ju — vl = /@, — v)? + We — v2), 


became interested in mathemat- which leads to the next definition. 


HISTORICAL NOTE 


ics at an early age. She heavily 

studied algebraic number theory 

and wrote a paper on the sum (V1, V2) 
of squares, which earned her 

the Ford Prize from the 
Mathematical Association of 
America. To read about her work, 
visit college.hmco.com/pic/ 
larsonELAG6e. 


A 


d(u, v) =|[u-v||= Jay — vp)? + (uy — v2)? 
Figure 5.4 
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Definition of Distance 


Between Two Vectors 


EXAMPLE 3 


Inner Product Spaces 


The distance between two vectors u and v in R” is 


d(u, v) = |lu — v|l. 


You can easily verify the three properties of distance listed below. 
1. d(u, v) = 0 
2. d(u, v) = 0 if and only if u = v. 
3. d(u, v) = dv, u) 


Finding the Distance Between Two Vectors 


Angle Between Two Vectors 


Figure 5.5 


Definition of 
Dot Product in R" 


The distance between u = (0, 2, 2) and v = (2, 0, 1) is 


d(u, v) = |[u — v|| = || — 2,2 - 0,2 —- b| 
= Jet $e = 3, 


Dot Product and the Angle Between Two Vectors 
To find the angle 6 (0 < @ < 7) between two nonzero vectors u = (w,, u,) and v = (v,, v3) 
in R?, the Law of Cosines can be applied to the triangle shown in Figure 5.5 to obtain 
lv — ul? = [lulP + [IvIP — 2lfull [lvl cos 6. 
Expanding and solving for cos 6 yields 


UyV, + UnVy 
lull {lvi] 


The numerator of the quotient above is defined as the dot product of u and v and is 
denoted by 


cos 8 = 


Us V = UV, + UgVo. 


This definition is generalized to R” as follows. 


The dot product of u = (u,,u,,...,u,,) and v=(v,,v,,.. .,v,) is the scalar quantity 


Ul \y = Wi Se HW ap Oo 9 8 ae YEA 


REMARK: Notice that the dot product of two vectors is a scalar, not another vector. 
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EXAMPLE 4| _ Finding the Dot Product of Two Vectors 
The dot product of u = (1, 2, 0, —3) and v = (3, —2, 4, 2) is 
u > v = (1)(3) + (2)(—2) + (O)(4) + (—3)(2) = -7. 


Technolo gy You can use a graphing utility or computer software program to find the dot product of two vectors. Using 
Note graphing utility, you can verify Example 4, and it may appear as follows. 


aotells Ws 


Keystrokes and programming syntax for these utilities/programs applicable to Example 4 are provided in 
the Online Technology Guide, available at co/lege.hmco.com/pic/larsonELA6e. 


THEOREM 5.3 If u, v, and w are vectors in R” and c is a scalar, then the following properties are true. 


Properties of the 1.u-v=v-u 
Dot Product 2. u-(v+w)=u-v+u-w 
3. clu: v) = (cu) - Vv =u: (cv) 
4.v-v=|lv|? 
5. v: v = 0, and v: v = Oif and only if v = 0. 
PROOF The proofs of these properties follow easily from the definition of dot product. For example, 


to prove the first property, you can write 


u'V= Vy, + Uv, +--+ + + UY, 
= VU; + Voy T° + * + VLU, 
=v-u. 


In Section 4.1, R” was defined as the set of all ordered n-tuples of real numbers. When 
R" is combined with the standard operations of vector addition, scalar multiplication, vector 
length, and the dot product, the resulting vector space is called Euclidean n-space. In the 
remainder of this text, unless stated otherwise, you may assume R” to have the standard 
Euclidean operations. 
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EXAMPLE 5|_ Finding Dot Products 


Given u = (2, —2), v = (5, 8), and w = (—4, 3), find 
(a) ur. (b) (u + v)w. (c) u> (2y). (d) ||w\|/. (e) u- (v — 2w). 


SOLUTION (a) By definition, you have 
u- v= 2(5) + (—2)(8) = —6. 


(b) Using the result in part (a), you have 
(u - v)w = —6w = —6(—4, 3) = (24, — 18). 


(c) By Property 3 of Theorem 5.3, you have 
u- (2v) = 2(u- v) = 2(—6) = —12. 
(d) By Property 4 of Theorem 5.3, you have 
|w|P = w+ w = (—4)(—4) + (3)@G) = 25. 


(e) Because 2w = (—8, 6), you have 
v — 2w = (5 — (—8), 8 — 6) = (13, 2). 


Consequently, 


u: (v — 2w) = 2(13) + (—2)(2) = 26 — 4 = 22. 


EXAMPLE 6| Using Properties of the Dot Product 


Provided with two vectors u and v in R” such that u- u = 39, u- v = —3, and 
v:v=79, evaluate (u + 2v) - (3u + v). 


SOLUTION Using Theorem 5.3, rewrite the dot product as 
(u + 2v) - Bu + v) =u- Bu + vy) + (2v) - (u+ y) 
=u- (u) +u-v+ (2v)-: (3u) + (2v)-v 
= 3(u-u) +u-v+ 6(v- wu) + 2Av- v) 
= 3(u- u) + 7(u- v) + 2Av-: Vv) 
= 3(39) + 7(-3) + 2(79) = 254. 


Discover 8 How does the dot product of two vectors compare with the product of their lengths? For instance, 
letu = (1,1) and v = (—4, —3). Calculate u - v and |\ul| ||v||. Repeat this experiment with other 
choices for u and v. Formulate a conjecture about the relationship between u - v and |\ul| ||v\). 


THEOREM 5.4 
The Cauchy-Schwarz 
Inequality 


PROOF 


EXAMPLE 7 
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To define the angle 6 between two vectors u and v in R”, you can use the formula in R? 


[ull {Ivll 


am 


For such a definition to make sense, however, the value of the right-hand side of this 
formula cannot exceed | in absolute value. This fact comes from a famous theorem named 
after the French mathematician Augustin-Louis Cauchy (1789-1857) and the German 
mathematician Hermann Schwarz (1843-1921). 


If u and v are vectors in R”, then 


| 


where |u - v| denotes the absolute value of u - v. 


ju > v| < |ulllly 


Case 1. If u = 0, then it follows that 
O-vj=0 and — |ul|||v|] = Oly|| = 0. 


ju vl = 


So, the theorem is true if u = 0. 
Case 2. If u # 0, let tf be any real number and consider the vector tu + v. Because 
(tu + v) + (tu + v) = O, it follows that 


(tu+ vy): (tu+v) =(u-u) + 2¢u-v) +v-v=0. 


Now, let a=u-u, b= 2(u- vy), and c=v-~v to obtain the quadratic inequality 
at? + bt + c = 0. Because this quadratic is never negative, it has either no real roots or a 
single repeated real root. But by the Quadratic Formula, this implies that the discriminant, 
b? — 4ac, is less than or equal to zero. 


b? — 4ac < 0 
b? < 4ac 
4(u + vy)? < 4(u- u)(v- v) 
(u- v)? < (u- ul(v-: v) 


Taking the square root of both sides produces 


Ju-v| < Ju-uJVv-v= [lull|lvi. 


An Example of the Cauchy-Schwarz Inequality 


Verify the Cauchy-Schwarz Inequality for u = (1, — 1, 3) and v = (2, 0, —1). 
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SOLUTION Becauseu- v = —l1,u-u= 11,andv- v = 5, you have 
luv] =|-1] =1 


and 


lull lvl] = Vu u /v-v = JSS = V55. 


The inequality holds, and you have |u - v| < |lul| ||v|. 


The Cauchy-Schwarz Inequality leads to the definition of the angle between two nonzero 
vectors in R”. 


Definition of the Angle The angle @ between two nonzero vectors in R” is given by 


Between Two Vectors in R" Pere aan 


OSG Sin 
[ull (lvl) 


REMARK: The angle between the zero vector and another vector is not defined. 


EXAMPLE 8| _ Finding the Angle Between Two Vectors 
The angle between u = (—4, 0, 2, —2) and v = (2, 0, — 1, 1) is 


9 u:v —12 12 
cos 6 = = = = 
lull lv] 24 V6 /144 


Consequently, 6 = 7. It makes sense that u and v should have opposite directions, because 
u = —2Vv. 


=I. 


Note that because ||u|| and ||v|| are always positive, u + v and cos @ will always have the 
same sign. Moreover, because the cosine is positive in the first quadrant and negative in the 
second quadrant, the sign of the dot product of two vectors can be used to determine 
whether the angle between them is acute or obtuse, as shown in Figure 5.6. 


Opposite Same 
direction direction 
6 
_f.\ u 
SS 
u Vv v 
O=T7 6=0 
cos 9 = -1 cos 8 =1 


Figure 5.6 


Definition of 
Orthogonal Vectors 


EXAMPLE 9 
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Figure 5.6 shows that two nonzero vectors meet at a right angle if and only if their dot 
product is zero. Two such vectors are said to be orthogonal (or perpendicular). 


Two vectors u and v in R” are orthogonal if 


u:v=0. 


REMARK: Even though the angle between the zero vector and another vector is not 
defined, it is convenient to extend the definition of orthogonality to include the zero vector. 
In other words, the vector 0 is said to be orthogonal to every vector. 


Orthogonal Vectors in R” 


(a) The vectors u = (1, 0, 0) and v = (0, 1, 0) are orthogonal because 
u- v = (1)(0) + (O)(1) + (0)(0) = 0. 

(b) The vectors u = (3, 2, —1, 4) and v = (1, —1, 1, 0) are orthogonal because 
u + v = (3)(1) + (2)(—-1) + (—1)C) + (4)(0) = 0. 


Determine all vectors in R* that are orthogonal to u = (4, 2). 


EXAMPLE 10|_ Finding Orthogonal Vectors 
SOLUTION Let v = (¥, v5) be orthogonal to u. Then 
(4, 2) u-+v = (4,2) + (vy, v.) = 4y, + 2v, = 0, 


Figure 5.7 


which implies that 2v, = —4v, and v, = —2y,. So, every vector that is orthogonal to (4, 2) 
is of the form 


v = (t, —2¢) = ¢(1, —2), 


where f¢ is a real number. (See Figure 5.7.) 


The Cauchy-Schwarz Inequality can be used to prove another well-known inequality 
called the Triangle Inequality (Theorem 5.5, page 288). The name “Triangle Inequality” 
is derived from the interpretation of the theorem in R?, illustrated for the vectors u and v 
in Figure 5.8(a). If you consider ||ul]| and ||v|| to be the lengths of two sides of a triangle, 
you can see that the length of the third side is |]u + v||. Moreover, because the length 
of any side of a triangle cannot be greater than the sum of the lengths of the other two sides, 
you have 


lu + vil < [lull + [lvl 


Figure 5.8(b) illustrates the Triangle Inequality for the vectors u and v in R?. 
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THEOREM 5.5 
The Triangle Inequality 


PROOF 


(a) 


llu+vi] < Hall + vl llu+ vi] < Hall + Ill 


Figure 5.8 


These results can be generalized to R” in the following theorem. 


If u and v are vectors in R”, then 


lu + vil < full + IIvil- 


Using the properties of the dot product, you have 
ju + vi? = (u + v): (u + y) 
=u-(ut+yv)+v-(u+v) 
=u'u+2u-y)tv-v 
= |lull? + 2(u - v) + |v? 
< |lul|? + 2Ju- v| + |/v|/. 


|, and you can write 


Now, by the Cauchy-Schwarz Inequality, |u + v| < ||ul| ||v 
lu + vIP < |lul? + 2]u - v] + [lvl 
< |lul? + 2[fulllivll + [vlP 
= (|lu| + [lvl 
Because both ||u + y|| and (\lu|| + ||v||) are nonnegative, taking the square root of both 
sides yields 


lu + vil< full + [lvl 


REMARK: Equality occurs in the Triangle Inequality if and only if the vectors u and v 
have the same direction. (See Exercise 117.) 


Section 5.1 Length and Dot Product in R" 289 


From the proof of the Triangle Inequality, you have 
lu + v|P = |lul? + 2G + v) + [lvIP. 


If u and v are orthogonal, then u - v = 0, and you have the extension of the Pythagorean 
Theorem to R” shown below. 


THEOREM 5.6 — Tf u and v are vectors in R”, then u and vy are orthogonal if and only if 
The Pythagorean Theorem ju + v|l2 = lull? + Ivif2. 


This relationship is illustrated graphically for R? and R? in Figure 5.9. 


The Dot Product and Matrix Multiplication 


It is often useful to represent a vector u = (u,, Uoiy ic et a u,,) in R” as an n X | column 
matrix. In this notation, the dot product of two vectors 


> X 


uy vy 
Uu Vv 
u= . and v= : 
Up Vp, 
can be represented as the matrix product of the transpose of u multiplied by v. 
vy 
Vo 
u:v=uv=[u, uw... u,)]|- |= lay, +tmy+---+ u,v, ] 
Yn 
Figure 5.9 For example, the dot product of the vectors 
3 
u= 2 and v=|-2 
=] 4 
is 
3 
u-v=wv=([1 2 —1] |-2} =[()(@) + (2)(-2) + (-1)(4] = —-5. 
4 


In this light, many of the properties of the dot product are direct consequences of the 
corresponding properties of matrix multiplication. 
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ante) em Exercises 


In Exercises 1—6, find the length of the vector. 


1. v = (4, 3) 2. v = (0, 1) 

3. v = (1, 2, 2) 4. v = (2,0, 6) 

5. v = (2,0, —5, 5) 6. v = (2, —4,5, —1, 1) 
In Exercises 7-12, find (a) ||ul}, (b) ||v||, and (c) |Ju + v|l. 


nu=(-14), v=(4-) 


8 u=(1,3), v= (2,-3) 
9 u = (0,4, 3), v= (1, -2, 1) 
10. u = (1,2,1),  v = (0,2, —2) 
11. u= (0,1, -1,2), v= (1, 1,3,0) 
12. u = (1,0,0,0), v = (0, 1,0, 0) 
In Exercises 13-18, find a unit vector (a) in the direction of u and 
(b) in the direction opposite that of u. 
13. u = (—5, 12) 14. u = (1, -1) 
15. u = (3, 2, —5) 16. u = (—1, 3,4) 
17. u = (1,0, 2, 2) 18. u = (—1, 1, 2,0) 
19. For what values of c is ||c(1, 2, 3)|| = 1? 
20. For what values of c is ||c(2, 2, — 1)|| = 3? 
In Exercises 21—26, find the vector v with the given length that has 
the same direction as the vector u. 
21. |v] =4, u =, 1) 22. |lv|] = 4, u=(-1,1) 
23. ||vl| = 2, u=(¥3,3,0) 24. |v] =4, u =(-1,2,1) 
25. ||v|| = 3, u = (0, 2, 1,—-1) 
26. ||v|| = 2, u = (1, —1,4,0) 


27. Given the vector v = (8, 8, 6), find u such that 
(a) uhas the same direction as v and one-half its length. 


(b) u has the direction opposite that of v and one-fourth its 
length. 


(c) whas the direction opposite that of v and twice its length. 
28. Given the vector v = (— 1, 3, 0, 4), find u such that 
(a) u has the same direction as v and one-half its length. 


(b) u has the direction opposite that of v and one-fourth its 
length. 


(c) whas the direction opposite that of v and twice its length. 


In Exercises 29-34, find the distance between u and v. 


29. u=(1,-1), v=(-1,1) 

30. u = (3,4), v= (7,1) 

31. u = (1, 1,2), v = (—1,3, 0) 

32. u = (1,2,0), v= (—1,4, 1) 

33. u = (0,1, 2,3), v = (1,0,4, -1) 
34. u = (0,1, —-1,2), v = (1, 1, 2, 2) 


In Exercises 35—40, find (a) u « v, (b) u + u, (c) |lu 
and (e) u « (5v). 

35. u = (3,4), v = (2, —3) 

36. u = (—1,2), v = (2, —2) 

37. u = (—1, 1, -2), v= (1, —3, —2) 

38. u = (2, -1, 1), v = (0,2, —-1) 

39. u = (4,0, —3,5), v = (0,2,5, 4) 

40. u = (0, 4, 3, 4,4), v = (6,8, —3, 3, —5) 


41. Find (u + v) - (2u — v), given that uc u= 4, u- v= —5, 
andv + v = 10. 


*, (d) (u + v)v, 


42. Find (3u — y) - (u — 3v), given that u- u = 8, u: v =7, 
andv-v = 6. 
In Exercises 43-58, use a graphing utility or computer software 
program with vector capabilities to find (a)-(f). 
(a) Norm of u and v 
(b) A unit vector in the direction of v 
(c) A unit vector in the direction opposite that of u 
(d)u-v 
(e) u:u 
(ff) v-v 
43. u = (5,—-12), v = (—8, —15) 
44, u = (3,-4), v = (5, 12) 
45. u = (5,12), v = (—12,5) 
46. u = (3, -4), v = (4,3) 
47. u = (10, —24), v = (—5, —12) 
48. u = (9,12), v = (—7, 24) 
49. u = (0,5, 12), v = (0, —5, —12) 
50. u = (3,0, —4),  v = (—3, —4, 0) 
51. u = (1,33), ¥ = (0.55) 


52. u = (-1,3,4), v = (0,4, -4) 


53. u = (0,1, V2), v =(-1, V2, -1) 
54. u = (-1, V3,2), v = (V2, -1, - V2) 
55. u = (0,2,2, -1,1,-2), v = (2,0, 1, 1,2, -2) 
56. u = (1,2, 3, —2, -1, -3), v = (—1,0,2, 1,2, —3) 
57. u = (-1,1,2,-1,1,1, -2, 1), 

v = (=1, 0, 1,2, =2, 1,.1,,=2) 
58. u = (3, -1,2, 1,0, 1,2, -1), 

v = (1,2, 0, -1, 2, —2, 1, 0) 


In Exercises 59-62, verify the Cauchy-Schwarz Inequality for the 
given vectors. 

59. u = (3,4), v = (2, —3) 

60. u = (—1,0), v=(1,1) 

61. u = (1,1,—-2), v=(, —3, —2) 

62. u = (1, —1,0), v= (0,1, —1) 


In Exercises 63—72, find the angle 6 between the vectors. 


63. u = (3,1), v = (—2,4) 
64. u = (2,—-1), v = (2,0) 
65. u = (cos 2 sin 2), v= (cos as sin 4 
6 6 4 4 
66. u = (cos a sin 7), v= (cos ‘, sin =) 
3 , 4 4 
67. u = (1,1, 1), v = (2,1, -1) 
68. u = (2,3, 1), v = (3, 2, 0) 
69. u = (0,1,0,1),  v = (3, 3, 3, 3) 
70. u= (1, -1,0,1), v = (—1, 2, —1, 0) 
71. u = (1,3, -1,2,0), v = (—1,4,5, —3, 2) 
72. u= (1, —-1,1,0,1), v=(,0, -1,0, 1) 


In Exercises 73-80, determine all vectors v that are orthogonal to u. 


73. u = (0,5) 74, u = (2,7) 

75. u = (—3, 2) 76. u = (0,0) 

77. u = (4, -1,0) 78. u = (2, —1, 1) 
79. u = (0, 1, 0,0, 0) 80. u = (0,0, —1, 0) 


In Exercises 81-88, determine whether u and v are orthogonal, 
parallel, or neither. 


81. u = (2,18), v = (3-2) 
1 
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83. u = (-4,3), v= (2, -4) 

84. u=(1,-1), v= (0, -1) 

85. u = (0, 1,0), v = (1, —2,0) 

86. u = (0, 1,6), v = (1, —2, -1) 

87. u = (—2,5, 1,0), v=(4,-3,0,1) 


88. u = (4,5, -1,3), v= (-2,-32-a) 


45) In Exercises 89-92, use a graphing utility or computer software 


program with vector capabilities to determine whether u and v are 
orthogonal, parallel, or neither. 


89. u = (-2,4,-1,3), v= (3,1, -3,0) 


90. u = (-7,9, -12,3), v = (0,6, 3, —3) 
o1. u = (-3,3,-5-6), v= -333) 
92, w=(-3,3 4-4), v= (-F,-23 4) 


Writing In Exercises 93 and 94, determine if the vectors are 
orthogonal, parallel, or neither. Then explain your reasoning. 


93. u = (cos 6, sin 6, —1),_ v = (sin 0, —cos 6, 0) 
94. u = (—sin 6, cos 6,1), v = (sin 0, —cos 8, 0) 


True or False? In Exercises 95 and 96, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


95. (a) The length or norm of a vector is 


IIvll = |v, + v2 + v3 roc 4 Vy. 


(b) The dot product of two vectors u and Vv is another vector 
represented by u + V = (W,Vj, U5V>, U3V3,. - » » UpVp)- 
96. (a) If Vv is a nonzero vector in R", the unit vector is 
u = v/|y|. 


(b) Ifu - v < 0, then the angle 6 between u and v is acute. 


Writing In Exercises 97 and 98, write a short paragraph explaining 
why each expression is meaningless. Assume that u and v are 
vectors in R”, and that c is a scalar. 


97. (a) |ju- v|| (b) u + (u- vy) 
98. (a) (u-v)-u- (b) c: (uy) 
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In Exercises 99-102, verify the Triangle Inequality for the vectors u 
and v. 

99. u = (4,0), v = (1, 1) 
101. u = (—1, 1), v = (2,0) 
102. u = (1, —1,0), v = (0, 1, 2) 


100. u = (1,1, 1), v = (0, 1,—2) 


In Exercises 103-106, verify the Pythagorean Theorem for the 
vectors u and v. 


103. u= (1,-1), v=(1,1) 
104. u = (3, -2), v= (4,6) 
105. u = (3,4, —2), v = (4, —3, 0) 
106. u = (4,1, —5), v = (2, —3, 1) 


107. Writing Explain what is known about 0, the angle between u 
and vy, if 
(a) u:v=0. 


(b) u- v > 0. (c)urv <0. 


In Exercises 108 and 109, let v = (v,, v) be a vector in R?. Show 
that (v,, —v,) is orthogonal to v, and use this fact to find two unit 
vectors orthogonal to the given vector. 


108. v = (12, 5) 109. v = (8, 15) 
110. Find the angle between the diagonal of a cube and one of its 
edges. 


111. Find the angle between the diagonal of a cube and the diagonal 
of one of its sides. 

112. Prove that if u, v, and w are vectors in R”, then (u + v) > w= 
u:wrtv:w. 

113. Guided Proof Prove that if u is orthogonal to v and w, then 
u is orthogonal to cv + dw for any scalars c and d. 


Getting Started: To prove that u is orthogonal to cv + dw, 
you need to show that the dot product of u and cv + dw is 0. 


114. 


115. 


116. 


117. 


118. 


119. 


120. 


121. 


(i) Rewrite the dot product of u and cv + dw as a linear 
combination of (u + v) and (u + w) using Properties 2 
and 3 of Theorem 5.3. 

(ii) Use the fact that u is orthogonal to v and w, and the 
result of part (i) to lead to the conclusion that u is 
orthogonal to cv + dw. 


Prove that if u and v are vectors in R”, then 


1 1 

u-v=gllu+ viP —gilu— vip. 

Prove that if u and v are vectors in R”, then 

y||? = 2|lul? + 2llv|?. 

Prove that the vectors u = (cos 6, —sin 6) and 

v = (sin 6, cos @) are orthogonal unit vectors for any value of 
6. Graph u and v for 6 = 77/3. 


Prove that |ju + v|| = |/ul] + ||v|| if and only if u and v have 
the same direction. 


Writing The vector u = (3240, 1450, 2235) gives the num- 
bers of bushels of corn, oats, and wheat raised by a farmer in a 
certain year. The vector v = (2.22, 1.85, 3.25) gives the prices 
in dollars per bushel of the three crops. Find the dot product 
u - v, and explain what information it gives. 


ju + v|P + lu 


Writing Let x be a solution to the m x n homogeneous linear 
system of equations Ax = 0. Explain why x is orthogonal to 
the row vectors of A. 


The vector u = (1245, 2600) gives the numbers of units of 
two models of mountain bikes produced by a company. The 
vector v = (225, 275) gives the prices in dollars of the two 
models, respectively. Find the dot product u + v and explain 
what information it gives. 


Use the matrix multiplication interpretation of the dot 
product, u - v = uy, to prove the first three properties of 
Theorem 5.3. 


5.2 | Inner Product Spaces 


In Section 5.1, the concepts of length, distance, and angle were extended from R? to R”. 
This section extends these concepts one step further—to general vector spaces. This is 
accomplished by using the notion of an inner product of two vectors. 

You already have one example of an inner product: the dot product in R". The dot 
product, called the Euclidean inner product, is only one of several inner products that can 
be defined on R”. To distinguish between the standard inner product and other possible 
inner products, use the following notation. 


Definition of 
Inner Product 


EXAMPLE 1 
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u + v = dot product (Euclidean inner product for R”) 


{u, v) = general inner product for vector space V 


A general inner product is defined in much the same way that a general vector space 
is defined—that is, in order for a function to qualify as an inner product, it must satisfy a 
set of axioms. The axioms parallel Properties 1, 2, 3, and 5 of the dot product given in 
Theorem 5.3. 


Let u, v, and w be vectors in a vector space V, and let c be any scalar. An inner product 
on V is a function that associates a real number (u, v) with each pair of vectors u and v 
and satisfies the following axioms. 

1. (u, v) = (v, u) 

2. (u,v + w) = (u,v) + (u, w) 

3. c(u, v) = (cu, v) 

4. (v, v) = 0, and (v, v) = 0 if and only if v = 0. 


REMARK: A vector space V with an inner product is called an inner product space. 
Whenever an inner product space is referred to, assume that the set of scalars is the set of 
real numbers. 


The Euclidean Inner Product for R” 


SOLUTION 


EXAMPLE 2 


Show that the dot product in R” satisfies the four axioms of an inner product. 
In R", the dot product of two vectors u = (u;,u5,. . .,u,) andv = (v,,¥,. . .,V,) is 
u'V= UV, + Uv, +--+ + U,Y,. 


By Theorem 5.3, you know that this dot product satisfies the required four axioms, which 
verifies that it is an inner product on R”. 


The Euclidean inner product is not the only inner product that can be defined on R”. 
A different inner product is illustrated in Example 2. To show that a function is an inner 
product, you must show that the four inner product axioms are satisfied. 


A Different Inner Product for R? 


SOLUTION 


Show that the following function defines an inner product on R?, where u = (u,, u,) and 
v = (vj, >). 


(u,v) = uv, + 2u,v, 


1. Because the product of real numbers is commutative, 


(u, V) = uv, + 2u,v = vu, + 2. = (V, U). 
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2. Let w = (w,, w2). Then 


(u,v + w) = u,(v, + w,) + 2u,(v, + ws) 
= uv, + uw, + 2u,V, + 2u,W, 
= (u,v, + 2u,v>) + (uyw, + 2u,w>) 
= (u,v) + (u, w). 
3. If c is any scalar, then 
c(u, v) = c(u,v, + 2u,v>) = (cu,)v,; + 2(cus)v, = (cu, v). 
4. Because the square of a real number is nonnegative, 
(v,v) = v7 + 2v5 = 0. 


Moreover, this expression is equal to zero if and only if v = 0 (that is, if and only if 
Vv) =v, = 0). 


Example 2 can be generalized to show that 


(u,v) = c,uyv, + Cv, ++ + + + C,u,V,, ¢ > 0 


non n? L 


is an inner product on R". The positive constants c,,. . .,c,, are called weights. If any c; 


a”n 


is negative or 0, then this function does not define an inner product. 


EXAMPLE 3 A Function That Is Not an Inner Product 


Show that the following function is not an inner product on R3, where u = (u;, U>, U3) and 
V = (1, Vo, V3). 


(u, V) = u,v, — 2u5v5 + u3V3 


SOLUTION Observe that Axiom 4 is not satisfied. For example, let v = (1,2, 1). Then (v,v) = 
(1)(1) — 2(2)(2) + (1)(1) = —6, which is less than zero. 


EXAMPLE 4| An Inner Product on M2,2 


Let 


ce & ie and B= is | 


44, = Ag2 by, Day 


be matrices in the vector space M, 5. The function 
(A, B) = ayyby, + ayyby, + yybj + Ayybr 


is an inner product on M, ,. The verification of the four inner product axioms is left to you. 
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You obtain the inner product described in the next example from calculus. The verifica- 
tion of the inner product properties depends on the properties of the definite integral. 


An Inner Product Defined by a Definite Integral (Calculus) 


Let f and g be real-valued continuous functions in the vector space Cla, b]. Show that 


(f.8) = [ F(x)g(x) dx 


defines an inner product on C[a, b]. 


SOLUTION  Youcan use familiar properties from calculus to verify the four parts of the definition. 


1, (6,2) = [ rove dx = i g(x)f(x) dx = (g,f) 


b b 
2. (he + m= f feist) + moi}ax= fC fadgt) + 7) 160] 


= {peels ae +f peaney ax = (ra) + GH 


b b 
3. c(f, 8) = | fx)g(x) dx = | cf(x)g(x) dx = (cf, 8) 


a 


4. Because [ f(x) = 0 for all x, you know from calculus that 
b 
(= | ood = 0 
with 
b 
(= | LoPar= 0 


if and only if fis the zero function in C[a, b], or if a = b. 


The next theorem lists some easily verified properties of inner products. 


THEOREM 5.7 
Properties of 
Inner Products 
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PROOF 


Definitions of Norm, 
Distance, and Angle 


EXAMPLE 6 


The proof of the first property follows. The proofs of the other two properties are left as 
exercises. (See Exercises 85 and 86.) From the definition of an inner product, you know 
(0, v) = (v, 0), so you only need to show one of these to be zero. Using the fact that 
O(v) = 0, 
(0, v) = (0(¥), v) 
= Ov, v) 
=0. 


The definitions of norm (or length), distance, and angle for general inner product spaces 
closely parallel those for Euclidean n-space. Note that the definition of the angle 0 between 
u and v presumes that 


(u,v) 
lullivi >| 


for a general inner product, which follows from the Cauchy-Schwarz Inequality shown later 
in Theorem 5.8. 


-l< 


Let u and v be vectors in an inner product space V. 

1. The norm (or length) of u is ||u|] = /(u, u). 

2. The distance between u and v is d(u, v) = ||u — vj. 

3. The angle between two nonzero vectors u and v is given by 
(u, v) 


CH= 777» Y= OS wm 
[ull {Iv 


4. u and v are orthogonal if (u, v) = 0. 


REMARK: If||v|] = 1, then vis called a unit vector. Moreover, if v is any nonzero vector 
in an inner product space V, then the vector u = v/||v|| is a unit vector and is called the 
unit vector in the direction of v. 


Finding Inner Products 


For polynomials p = dy t+ ax +--+ + a,x" and g=b) + bx+- +++ b,x" in the 
vector space P,, the function 


(Pp, q) = Agdo ca a,b, See a,b, 


is an inner product. Let p(x) = 1 — 2x2, g(x) = 4 — 2x + x*, and r(x) = x + 2x? be 
polynomials in P,, and determine 


(a) (p,q). = (b”) (g.r). =~ ©) lg. = @ dp, @). 


SOLUTION 


EXAMPLE 7 
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(a) The inner product of p and g is 
(2.4) = Agby + a,b, + ayb, 
= (1)(4) + (0)(—2) + (—2)(1) = 2. 
(b) The inner product of qg and r is 
(qr) = (4)(0) + (—2)() + (D(2) = 0. 
(c) The norm of g is 
llall = Va,@) = V# + (-2)? + P= 21. 
(d) The distance between p and gq is 
ap, q) = lp — ll = || — 2x) — (4 — 2x + 2) 
= ||-3 + 2x — 3x?|| 
= J/(-3? + 2 + (3 = 22. 


Notice that the vectors g and r are orthogonal. 


Orthogonality depends on the particular inner product used. That is, two vectors may be 
orthogonal with respect to one inner product but not to another. Try reworking Example 6 
using the inner product (p, q) = dyby + a,b, + 2a,b,. With this inner product the only 
orthogonal pair is p and q. 


Using the Inner Product on C[O, 1] (Calculus) 


SOLUTION 


Use the inner product defined in Example 5 and the functions f(x) = x and g(x) = x? in 
C[O, 1] to find 


(a) |[f||. — (&) d(f, 8). 


(a) Because f(x) = x, you have 


ine =.9= | wioar=[eae=[2]) = 4.56. 
(b) To find d(f, g), write 
[deh =f ef > 2) 


1 
l= 


= [ [f(x) — g@)Pdx = [o — 2°) dx 


! 3 4 si 1 
= 2— 9x3 + x4 - ¥ +2] - : 
je nore E 2° 5) 30 


1 
So, df, g) = 0" 
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Technolo gy Many graphing utilities and computer software programs have built-in routines for approximating 
Note definite integrals. For example, on some graphing utilities, you can use the fnint command to verify 
Example 7(b). It may look like: 


A OL Peas 1 
2182574185835 


] 
Th It should b imately 0.182574 ~ : 
e result should be approximately 0.1825 J 


Keystrokes and programming syntax for these utilities/programs applicable to Example 7(b) are 
provided in the Online Technology Guide, available at college hmco.com/pic/larsonELA6e. 


In Example 7, you found that the distance between the functions f(x) = x and g(x) = x? 
in C[O, 1] is 1/ /30 ~ 0.183. In practice, the actual distance between a pair of vectors is 
not as useful as the relative distance between several pairs. For instance, the distance 
between g(x) = x? and h(x) = x? + 1 in C[0, 1] is 1. From Figure 5.10, this seems reason- 
able. That is, whatever norm is defined on C[0, 1], it seems reasonable that you would want 
to say that f and g are closer than g and h. 


y y 
A A 
2+ 27 
fa h(x) =x74+1 
f(x) =x 
1 
eee 
+ > xX 
; i 2 
df, 8) = 7 dh, g) =1 


Figure 5.10 


The properties of length and distance listed for R” in the preceding section also hold for 
general inner product spaces. For instance, if u and v are vectors in an inner product space, 
then the following three properties are true. 
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Properties of Norm Properties of Distance 

1. |lul] = 0 1. du, v) = 0 

2. |u|] = 0 if and only ifu = 0. 2. d(u, v) = 0 if and only if u = v. 
3. ||cul] = |e] [lull 3. d(u, v) = d(v, u) 


Theorem 5.8 lists the general inner product space versions of the Cauchy-Schwarz 
Inequality, the Triangle Inequality, and the general Pythagorean Theorem. 


THEOREM 5.8 Let u and v be vectors in an inner product space V. 


1. Cauchy-Schwarz Inequality: |(u, v)| < ||ull ||v]| 
2. Triangle Inequality: ||u + v|| < |lul| + ||v]| 
3. Pythagorean Theorem: u and v are orthogonal if and only if 


lu + vi? = [lul? + [lvI?. 


The proofs of these three axioms parallel those for Theorems 5.4, 5.5, and 5.6. Simply 
substitute (u, v) for the Euclidean inner product u : v. 


EXAMPLE 8| An Example of the Cauchy-Schwarz Inequality (Calculus) 


Let f(x) = 1 and g(x) = x be functions in the vector space C[0, 1], with the inner product 
defined in Example 5, 


(roa) = | Feael a 


Verify that |(f, g)| = [Ifll lle 
SOLUTION For the left side of this inequality you have 
1 1 21 
x 1 
18) = [ reve dx = [ xa = =| =a 
" 6 210 2 


For the right side of the inequality you have 


1 


IFIP = [ rear dx = [a = x| =1 


10) 


and 


ptf ee ee ee 
lel = [ stoaerar= [x ae 


0 


Isle = / (4) = 45 ~ 0577, ana [C6291 < Isl ll 


So, 


300 = 3=Chapter 5 


1 


Figure 5.12 


EXAMPLE 9 


Inner Product Spaces 


Orthogonal Projections in Inner Product Spaces 


Let u and v be vectors in the plane. If v is nonzero, then u can be orthogonally projected 
onto v, as shown in Figure 5.11. This projection is denoted by proj,u. Because proj,u is a 
scalar multiple of v, you can write 


proj,u = av. 
If a > O, as shown in Figure 5.11(a), then cos 0 > O and the length of proj,u is 


jul] |v\|cos@ ou-v 
IIv|| Ilv 


llav|| = lal [lvl] = allyl] = [lull cos 6 = 


? 


which implies that a = (u - y)/||v|? = (u- v)/(v = v). So, 


, u:v 
projyu = 
Vv 


If a < 0, as shown in Figure 5.11(b), then it can be shown that the orthogonal projection 
of u onto v is the same formula. 


(a) . (b) ¢ 
u/ : | \u 
| | ¢ 
(4) 1 = 1 Xx) ¥ 
Aaa e o> e 
projyu =av,a>0 projyu = av,a<0 
Figure 5.11 


Finding the Orthogonal Projection of u onto v 


In R?, the orthogonal projection of u = (4, 2) onto v = (3, 4) is 


; uv (4, 2) + (3, 4) 
Pe (3,4) - (3, ay? 4) 


as shown in Figure 5.12. 


The notion of orthogonal projection extends naturally to a general inner product space. 


Definition of 


Orthogonal Projection 


Figure 5.13 


EXAMPLE 10 
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Let u and v be vectors in an inner product space V, such that v # 0. Then the orthogo- 
nal projection of u unto v is given by 


(u, v) 
(y, v) Ve 


proj,u = 


REMARK: If visa unit vector, then (v, v) = ||v||? = 1, and the formula for the orthogo- 
nal projection of u onto v takes the simpler form 


proj,u = (u, v)v. 


Finding an Orthogonal Projection in R? 


SOLUTION 


Use the Euclidean inner product in R? to find the orthogonal projection of u = (6, 2, 4) 
onto v = (1, 2, 0). 


Because u + v = 10 and ||v||? = v - v = 5S, the orthogonal projection of u onto v is 


u:v 


proj,u = v 


V:v 

10 
= —(1,2 

5 Ul , 0) 
2(1, 2, 0) 


= (2,4, 0), 


as shown in Figure 5.13. 
4 


REMARK: Notice in Example 10 that u — projju = (6, 2, 4) — (2, 4,0) = (4, —2, 4) is 
orthogonal to v = (1, 2, 0). This is true in general: if u and v are nonzero vectors in an 
inner product space, then u — proj,u is orthogonal to v. (See Exercise 84.) 


An important property of orthogonal projections used in approximation problems (see 
Section 5.4) is shown in the next theorem. It states that, of all possible scalar multiples of 
a vector v, the orthogonal projection of u onto v is the one closest to u, as shown in Figure 
5.14. For instance, in Example 10, this theorem implies that, of all the scalar multiples of 
the vector v = (1, 2,0), the vector proj,u = (2, 4, 0) is closest to u = (6, 2, 4). You are 
asked to prove this explicitly in Exercise 90. 
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e 2 
i \ 
I y, i 
u/ | uf dtu, cv) 
. \ atu, CV 
: d(u, projyu) \ 
| \ 
*N 
1 % 
> Mé >e Zs Md e 
projyu cv 
Figure 5.14 


THEOREM 5.9 Let u and v be two vectors in an inner product space V, such that v # 0. Then 
Orthogonal Projection 


(u, Vv) 
and Distance ; 


du, projyu) < du, cv), c# 
(Vv, Vv) 


PROOF  Letb = (u, v)/<v, v). Then you can write 


ju — cv||? = ||(u — by) + (b — c)v 


P, 
where (u — by) and (b — c)v are orthogonal. You can verify this by using the inner prod- 
uct axioms to show that 

((u — bv), (b — c)v) = 0. 
Now, by the Pythagorean Theorem you can write 


(u — bv) + (b — c)v|/? = |lu — byl? + |e — cv 


I? 
which implies that 
u — cy|? = |lu — dv|? + (6 — cPllv|I?. 


Because b # c and v ¥ 0, you know that (b — c)?||v||? > 0. So, 


N 


u — by|? < |lu — cv), 
and it follows that 


du, bv) < d(u, cv). 


The next example discusses a type of orthogonal projection in the inner product space 
Cla, b]. 


EXAMPLE 11| 
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Finding an Orthogonal Projection in C[a, b] (Calculus) 


Let f(x) = 1 and g(x) = x be functions in C[O, 1]. Use the inner product defined in 


Example 5, 


(fg) = [ “Fo g(x) 


to find the orthogonal projection of f onto g. 


SOLUTION 


From Example 8 you know that 


1 
(fig) =5 and [lg = (g. 8) = 5 


So, the orthogonal projection of f onto g is 


proj,f= 2 ¢ 
e  ABS 8) 
_ 1/2 
1/3” 
_3 
5*: 
NAST) ywa Exercises 
In Exercises 1-10, find (a) (u, v), (b) |u|], (c) ||v||, and (d) d(u, v) 10. u = (1, —1, 2,0), v = (2, 1,0, —-1), 


for the given inner product defined in R”. 
u = (3,4), v=(5,-12), (u,v) =u-v 
u=(1,1), v=(7,9), (u,v) =u-v 
u = (—4,3), v=(0,5), (u,v) = 3u,v, + u,v, 
u = (0,—-6), v=(-1,1), (u,v) = my, + uv, 
u = (0,9,4), v =(9,-2,—-4), (u,v) =u-v 
u = (0,1,2), v=(1,2,0), (u,v) =u-v 
u = (8,0, —8), v = (8, 3, 16), 
(u, Vv) = 2u,v, + 3unv2 + UV; 
8. u=(1,1,1), v= (2,5, 2), 

(u, Vv) = wv, + 2u,v. + u3V3 
9. u = (2,0,1,-1), v = (2,2,0, 1), 


(u,v) =u-v 


aS OU Re oe 


(u,v) =u-v 


Calculus In Exercises 11-16, use the functions f and g in C[-1, 1] 
to find (a) (f,g), (b) || f||, (c) |g |], and (d) d(f, g) for the inner product 


(fig) = [ f(x)g(x) dx. 


11. f(x) = 2?, gd) =e? +1 

12. f(x) = -x, ge) =r? -x4+2 
13. f(xy) =x, gx) =e 

14. f(x) =x, g(x) =e* 

15. f(x) = 1, g(x) = 3x? - 1 

16. f(x) = -1, eg) = 1 - 2x 
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In Exercises 17-20, use the inner product (A, B) = 2a,,b,, + 
yd, + Ady) + 2dyy 
(d) d(A, B) for the matrices in M, >. 


.A=|") B=(\ nal 
4 <2 i 


1 0 
18. A= B= 
‘ lo ih 


| 
9. 4=[) | B=|5 0 
| 


1 
Si Jes 


0 -1 
In Exercises 21-24, use the inner product (p,q) = dyb, + 
a,b, + ab, to find (a) (p,q), (6) III , and (d) d(p, q) for 
the polynomials in P). 


21. p(x) =1—x4+ 3x, dx =x-¥ 
22. p(x) =1 txt 42, g(x) = 14 2x 
23. p(x) = 14+ x7, gx) =1-x 

24. p(x) =1— 2x — x7, g(x) =x-— x? 


In Exercises 25-28, prove that the indicated function is an inner 
product. 

25. (u, v) as shown in Exercise 3 

26. (u, v) as shown in Exercise 7 

27. (A, B) as shown in Exercises 17 and 18 

28. (p, q) as shown in Exercises 21 and 23 


Writing In Exercises 29-36, state why (u,v) is not an inner 
product for u = (u,, v5) and v = (v,, v,) in R?. 

29. (u,v) = u,v, 30. (u,v) = —u,v, 

31. (u,v) = WV, — UV, 32. (u,v) = u,v, — 2u,v, 
33. (u,v) = upv? + usve 


35. (u, Vv) = 3u,v5 — Unv, 


34. (u,v) = ufv? — usvs 
36. (U,V) = UU + VyV5 
In Exercises 37—46, find the angle between the vectors. 


37. u = (3,4), v= (5,—-12), (u,v) =u-v 

38. u = (2, —1), v= (5, 1), (u,v) =u-v 

39. u = (—4,3), v= (0,5), (u,v) = 3u,v, + uv, 
40. u = (4,-1), v=(2,1), (u,v) = 2uv, + wv, 
41. u=(1,1,1), v= (2,-2,2), 


(u,v) = U,V, + 2UnV. + U3V3 


42. u=(0,1,-1), v=(1,2,3), (u,v) =u-v 
43. p(x) =1—x4+2x, ga) =1ltxtx, 

(P. 4) = dgby + a,b, + andy 
44, p(x) = 142%, g(x) =x — 2, 

(P,) = Agby + 2a,b, + ayb, 


45, Calculus f(x) =x, g(x) = x, 
(h8) = “fodel dx 

46. Calculus f(x) =1, ¢(x) =X, 
(har “fede dx 


In Exercises 47-58, verify (a) the Cauchy-Schwarz Inequality and 
(b) the Triangle Inequality. 

47, u = (5,12), ¥= (3,4), (u,v) =U-¥ 

48. u=(-1,1), v=(1,-1), (uv) =u-v 

49. u=(1,0,4), v=(-5,4,1), (u,v) =u-v 

50. u= (1,0,2), v=(1,2,0), (u,v) =u-v 

51. p(x) = 2x, g(x) = 3x7 + 1, (p,q) = agby + ab, + ab, 
52. p(x) =x, g(x) =1— 3x7, (p,q) = agby + 2a,b, + anb, 


0 3 =3 1 
eee ae 
2 1 + 3 


(A, B) = aby, + ayadiy + Ay {by + Ay2bo9 


0 1 1 1 
sua=[) ib B=|) | 
2 -1 2 =2 


(A, B) = ayybyy + ayadiy + Ay bo) + Ayybr9 


55, Calculus f(x) = sinx, g(x) = cos, 
ie) = = fed) dx 

56. Calculus f(x) =x, (x) = cos mx, 
G8) = [ reo dx 

57. Calculus f(x) =x, g(x) =e, 


(f.g) = [ f(x)g(x) dx 


58. Calculus f(x) =x, g(x) =e, 


Ke [ ‘padbie 


Calculus In Exercises 59-62, show that f and g are orthogonal in 
the inner product space C[a, b] with the inner product 


b 
(f. 8) = | f(x)g(x) dex. 


59. C[—a, 7], f(x) =cosx, g(x) = sinx 

60. C[-1,1], f@) =x a(x) = 33 - 1) 

61. C[-1,1], f(x) =x, g(x) = 3(5x3 — 3x) 

62. C[0, a], f(x) = 1, g(x) = cos(2nx), n= 1,2,3,... 
In Exercises 63-66, (a) find proj,u, (b) find proj,,v, and (c) sketch 
a graph of both proj,u and proj,,v. 

63. u = (1,2), v = (2,1) 

64. u = (—1,-2), v= (4,2) 

65. u = (— 1,3), v = (4,4) 

66. u = (2, —2), v = (3,1) 

In Exercises 67—70, find (a) projyu and (b) proj, v. 

67. u = (1,3,—-2), v= (0,-1,1) 

68. u = (1,2,-1), v =(-1,2,-1) 

69. u = (0, 1,3, —6),  v = (—1, 1, 2, 2) 

70. u = (—1,4, —2,3),  v = (2, -1,2, —1) 


Calculus In Exercises 71-78, find the orthogonal projection of 
f onto g. Use the inner product in C[a, b] 


b 
(f. 8) = i f(x)g(x) dex. 


71. C[-1,1], f@m=x ge =1 

72. C[-1,1], f@) =x%--x, g(x) =2x-1 
73. C[0,1], f(x) =x, g(x) =e 

74. C[0,1], f(x) =x, 9x) =e 

75. C[—7, 7], f(x) = sinx, g(x) = cosx 
76. C[—7, ml, f(x) = sin2x, g(x) = cos 2x 
77. Cl[—a, ml, f(x) =x, g(x) = sin 2x 

78. C[—7a, 7], f(x) =x, g9(x) = cos 2x 
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True or False? In Exercises 79 and 80, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


79. (a) The dot product is the only inner product that can be 
defined in R”. 


(b) Of all the possible scalar multiples of a vector v, the 

orthogonal projection of u onto v is the vector closest to u. 

80. (a) The norm of the vector u is defined as the angle between 
the vector u and the positive x-axis. 


(b) The angle 6 between a vector v and the projection of u onto 
v is obtuse if the scalar a < O and acute if a > 0, where 
av = proj,u. 


81. Let u = (4, 2) and v = (2, —2) be vectors in R? with the inner 
product (u, v) = u,v, + 2uyV5. 
(a) Show that u and v are orthogonal. 


(b) Sketch the vectors u and v. Are they orthogonal in the 
Euclidean sense? 
82. Prove that |[u + v||? + |[u — v||? = 2lul|? + 2\|v|/? for any 
vectors u and v in an inner product space V. 


83. Prove that the function is an inner product for R”. 


(u, V) = CyUyV, + Colyv, +--+ +> + c,u,v,, ¢ > 0 


non n? 


84. Let u and v be nonzero vectors in an inner product space V. 
Prove that u — projyu is orthogonal to v. 


85. Prove Property 2 of Theorem 5.7: If u, v, and w are vectors in 
an inner product space, then (u + v, w) = (u, w) + (v, w). 


86. Prove Property 3 of Theorem 5.7: If u and v are vectors in an 
inner product space and c is a scalar, then (u, cv) = c(u, V). 


87. Guided Proof Let Wbea subspace of the inner product space 
V. Prove that the set W+ is a subspace of V. 


W+ = {v © V: (v, w) = 0 forall w © W} 
Getting Started: To prove that W+ is a subspace of V, you 


must show that W+ is nonempty and that the closure conditions 
for a subspace hold (Theorem 4.5). 


(i) Find an obvious vector in W* to conclude that it is 
nonempty. 


(ii) To show the closure of W+ under addition, you need to 
show that (v, + v5, w) = 0 for all w © W and for any 
V,, V> © W*. Use the properties of inner products and 
the fact that (v,, w) and (v5, w) are both zero to show 
this. 
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(iii) To show closure under multiplication by a scalar, Getting Started: To prove (a) and (b), you can make use of 
proceed as in part (ii). You need to use the properties of both the properties of transposes (Theorem 2.6) and the proper- 

inner products and the condition of belonging to W*. ties of dot products (Theorem 5.3). 
88. Use the result of Exercise 87 to find W+ if W is a span of (i) To prove part (a), you can make repeated use of the 


(1, 2, 3) in V = R?. 


89. Guided Proof Let (u, v) be the Euclidean inner product on 
R”. Use the fact that (u, v) = u’v to prove that for any n x n 


matrix A 


(a) (Au, v) = (u, Av) and (b) (A7Au, u) = ||Aull. 


Definitions of Orthogonal 


and Orthonormal Sets 


property (u, v) = u’v and Property 4 of Theorem 2.6. 


(ii) To prove part (b), you can make use of the property 
(u, v) = uy, Property 4 of Theorem 2.6, and Property 
4 of Theorem 5.3. 


90. The two vectors from Example 10 are u = (6,2,4) and 
v = (1, 2, 0). Without using Theorem 5.9, show that among all 
the scalar multiples cv of the vector v, the projection of u 
onto v is the vector closest to u—that is, show that d(u, proj,u) 
is a minimum. 


5.3 | Orthonormal Bases: Gram-Schmidt Process 


You saw in Section 4.7 that a vector space can have many different bases. While studying 
that section, you should have noticed that certain bases are more convenient than others. For 
example, R? has the convenient standard basis B = {(1, 0, 0), (0, 1, 0), (0, 0, 1)}. This set 
is the standard basis for R? because it has special characteristics that are particularly useful. 
One important characteristic is that the three vectors in the basis are mutually orthogonal. 
That is, 


(1, 0, 0) - (0, 1,0) =0 
(1, 0, 0) - (0,0, 1) = 0 
(0, 1, 0) - (0,0, 1) = 0. 
A second important characteristic is that each vector in the basis is a unit vector. 
This section identifies some advantages of bases consisting of mutually orthogonal unit 


vectors and develops a procedure for constructing such bases, known as the Gram-Schmidt 
orthonormalization process. 


A set S of vectors in an inner product space V is called orthogonal if every pair of 
vectors in S is orthogonal. If, in addition, each vector in the set is a unit vector, 
then S is called orthonormal. 


For S = {v,,V>,. . .,V,,J. this definition has the form shown below. 
Orthogonal Orthonormal 
1, 9) Oey 1 WV =O, Fy 


2. Ilv;|| = 1, b= 1256 ag 


Figure 5.15 


Figure 5.16 


EXAMPLE 1 
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If S is a basis, then it is called an orthogonal basis or an orthonormal basis, respectively. 

The standard basis for R” is orthonormal, but it is not the only orthonormal basis for 
R". For instance, a nonstandard orthonormal basis for R? can be formed by rotating the 
standard basis about the z-axis to form 


= {(cos @, sin 0, 0), (—sin 6, cos 0, 0), (0, 0, 1)}, 


as shown in Figure 5.15. Try verifying that the dot product of any two distinct vectors in B 
is zero, and that each vector in B is a unit vector. Example | describes another nonstandard 
orthonormal basis for R?. 


A Nonstandard Orthonormal Basis for R? 


SOLUTION 


Show that the set is an orthonormal basis for R?. 


Vv, Vo ¥3 
s={(- 50), (222%) (2 2,2) 
Vii Ts 69 GB Pe 8 
First show that the three vectors are mutually orthogonal. 
: + : +0=0 
Vv, °V> ae 
2 2 
v,° V3 0=0 


9 9 9 
Now, each vector is of length 1 because 
Iml= Vary = vetE+0=1 
Il¥ol| = VV + Vo Vetet5=1 
Iva = Vir v3 = V5 +5 +5 = 1. 


So, S is an orthonormal set. Because the three vectors do not lie in the same plane (see 
Figure 5.16), you know that they span R?. By Theorem 4.12, they form a (nonstandard) 
orthonormal basis for R°. 
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EXAMPLE 2 An Orthonormal Basis for P3 


EXAMPLE 3 


In P;, with the inner product 
(P.q) = Agby + ayy + ayby + agbz, 


the standard basis B = {1, x, x”, x3} is orthonormal. The verification of this is left as an 
exercise. (See Exercise 19.) 


The orthogonal set in the next example is used to construct Fourier approximations of 
continuous functions. (See Section 5.5.) 


An Orthogonal Set in C[O, 277] (Calculus) 


SOLUTION 


HISTORICAL NOTE 


Jean-Baptiste Joseph Fourier 
(1768-1830) 

is credited as a significant 
contributor to the field of 
education for scientists, mathe- 
maticians, and engineers. His 
research led to important results 
pertaining to eigenvalues, 
differential equations, and 
Fourier series (functions by 
trigonometric series). His work 
forced mathematicians of that 
day to accept the definition of a 
function, which at that time was 
very narrow. To read about his 
work, visit college.hmco.com/ 
pic/larsonELA6e. 


In C[0, 277], with the inner product 


(£8) = [ f(x)g(x) dx, 


show that the set S = {1, sin x, cos x, sin 2x, cos 2x,. . ., sin nx, cos nx} is orthogonal. 


To show that this set is orthogonal, you need to verify the inner products shown below, where 
m and n are positive integers. 


27 
(1, sin nx) = [ sin nx dx = 0 


0 


207 

(1, cos nx) = [ cos nx dx = 0 

0 
277 


(sin mx, COs nx) = [ sin mx cos nx dx = 0 
0 
277 
(sin mx, sin nx) = [ sin mx sinnx dx = 0, m#n 
0 
277 
(cos mx, COS NX) = [ cosmxcosnxdx =0, m#n 
0 
One of these products is verified, and the others are left to you. If m # n, then the 
formula for rewriting a product of trigonometric functions as a sum can be used to obtain 


297 20 
1 
[ sin mx cos nx dx = Al [sin(m + n)x + sin(m — n)x] dx 
0 0 


1 + 
kx n)x 4. 


cos(m — me * 
2 m+n m—n 0 


THEOREM 5.10 
Orthogonal Sets Are 
Linearly Independent 


PROOF 
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If m = n, then 


277 
. 1 . 27 
sin mx cos mx dx = —— sin’ ms = 0. 
0 2m 0 


Note that Example 3 shows only that the set S is orthogonal. This particular set is not 
orthonormal. An orthonormal set can be formed, however, by normalizing each vector in S. 
That is, because 


20 
ye = [ dx = 27 
0 


20 
||sin nx||? = [ sin? nx dx = 7 
0 


20 
I|cos nx||? = [ cos? nx dx = 7, 
0 


it follows that the set 


a 
F sin x, 
Jia Ja Va 
is orthonormal. 
Each set in Examples 1, 2, and 3 is linearly independent. Linear independence is a 
characteristic of any orthogonal set of nonzero vectors, as stated in the next theorem. 


COS X,. . ., = sin nx, —— cos ne 


Jar Ja 


If S = {v,, V5,. . ., V,,} is an orthogonal set of nonzero vectors in an inner product space 
V, then S is linearly independent. 


You need to show that the vector equation 


CV, + OV, +--+ + ,V, = 9 


implies c, = c, = + + + =, = 0. To do this, form the inner product of the left side of the 


n 
equation with each vector in S. That is, for each i, 
((cyV, + GV, ++ ++ tov, +++ + +0,v,), Vv) = (0, v,) 
CAV), V,) + (Vy, V;)) + + + cXv,,V)) +--+ ,(v,, Vv) = 0. 


n? 
Now, because S is orthogonal, (V;5 Vv) = 0 for 7 # i, and now the equation reduces to 
cAV;, V;) = 0. 
But because each vector in S is nonzero, you know that 
(V;, Vi) = Ilv.IP ~ 0. 


So every c; must be zero and the set must be linearly independent. 
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COROLLARY TO 


THEOREM 5.10 


EXAMPLE 4 


As a consequence of Theorems 4.12 and 5.10, you have the result shown next. 


Using Orthogonality to Test for a Basis 


SOLUTION 


W, = projiw 


W=W, + Wo =ci + Crj 


Figure 5.17 


THEOREM 5.11 


Coordinates Relative to an 
Orthonormal Basis 


Show that the following set is a basis for R*. 


Vv, Vv Vv V4 


2 3 
S = {(2, 3, 2, —2), (1, 0, 0, 1), (—1, 0, 2, 1), (—1, 2, -1, 1)} 


The set S has four nonzero vectors. By the corollary to Theorem 5.10, you can show that $ 
is a basis for R* by showing that it is an orthogonal set, as follows. 

Vi°V,=2+07+0-2=0 

V¥°V,=-2+074-2=0 

Vi°V= -2+6-2-2=0 

v,°vV, = —-1+07+0+1=0 

vo°Wy=-1+0+04+1=0 

Vo2¥, =r O=25r 10 


S is orthogonal, and by the corollary to Theorem 5.10, it is a basis for R*. 


Section 4.7 discussed a technique for finding a coordinate representation relative to a 
nonstandard basis. If the basis is orthonormal, this procedure can be streamlined. 

Before presenting this procedure, you will look at an example in R?. Figure 5.17 shows 
that i = (1,0) andj = (0, 1) form an orthonormal basis for R?. Any vector w in R? can be 
represented as w = w, + W), where w, = proj,;w and w, = proj;w. Because i and j are 
unit vectors, it follows that w, = (w - i)i and w, = (w - j)j. Consequently, 


w=w,t we 


Il 


(w- iit (w- jj 
= ci + cj, 


which shows that the coefficients c, and c, are simply the dot products of w with the 
respective basis vectors. This is generalized in the next theorem. 


If B = {v,, V>,- . -,V,f iS an orthonormal basis for an inner product space V, then the 
coordinate representation of a vector w with respect to B is 


w = (w,V,)v, + (Ww, v,)v> +> >: + (Ww, V,)v,,. 
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PROOF Because B is a basis for V, there must exist unique scalars c,,c,,. . ., c,, Such that 

W=CV, + OV, +--+ > + ©¢,Y,. 
Taking the inner product (with v,) of both sides of this equation, you have 

(w, v,) = (cv, + GV, ++: + + +0,V,), V)) 

= 04% 3 Vi) F OWVos Vp ee > a OAV YD 

and by the orthogonality of B this equation reduces to 

(w, v)) = kV, Vi). 
Because B is orthonormal, you have (v,, v;) = ||v;||? = 1, and it follows that (w, v,) = c;. 

In Theorem 5.11 the coordinates of w relative to the orthonormal basis B are called the 

Fourier coefficients of w relative to B, after the French mathematician Jean-Baptiste 
Joseph Fourier (1768-1830). The corresponding coordinate matrix of w relative to B is 

[wl], =[e, &- + > ¢,/F 

= L{w, vi) (w, V>) aoa (w, Pe 
EXAMPLE 5| _ Representing Vectors Relative to an Orthonormal Basis 
Find the coordinates of w = (5, —5, 2) relative to the orthonormal basis for R? shown 
below. 
Vv, V> V3 
34 4 3 
B = {(3,5,0), (-3,3,0), (0,0, 1} 
SOLUTION Because B is orthonormal, you can use Theorem 5.11 to find the required coordinates. 


w-v, =(5,—-5,2)- (34,0) =-1 
= 4 3 = 
wv, = (5, —5,2)° (-$,3, 0) = 7 
wv; = (5, —5, 2): (0,0, 1) =2 
So, the coordinate matrix relative to B is 
—1 
[wl], =| 7}. 
2 


312 


Chapter 5 


THEOREM 5.12 
Gram-Schmidt 


Orthonormalization Process 


Inner Product Spaces 


Gram-Schmidt Orthonormalization Process 


Having seen one of the advantages of orthonormal bases (the straightforwardness of coor- 
dinate representation), you will now look at a procedure for finding such a basis. This 
procedure is called the Gram-Schmidt orthonormalization process, after the Danish 
mathematician Jorgen Pederson Gram (1850-1916) and the German mathematician Erhardt 
Schmidt (1876-1959). It has three steps. 


1. Begin with a basis for the inner product space. It need not be orthogonal nor consist of 
unit vectors. 

2. Convert the given basis to an orthogonal basis. 

3. Normalize each vector in the orthogonal basis to form an orthonormal basis. 


REMARK: The Gram-Schmidt orthonormalization process leads to a matrix factorization 
similar to the LU-factorization you studied in Chapter 2. You are asked to investigate this 
QR-factorization in Project | at the end of this chapter. 


1, USE IE = Wi Wane © 
2. Let B= {W,, Wo... 


, V, } be a basis for an inner product space V. 


, W,,}, where w, is given by 


Ww, — Vv, 
qiavee (Vo, Wi) 
(Ww), W)) i 
(v3, W)) (V3, W>) 
Ny = Nig = Wi 2 
(Wi, w)) (Wo, W>) 
We w)) Wes W>) AV Wr 1) 
Vika = 7 a a a) nen eo 


Vv WwW WwW 
‘ (wi, w)) ; (wp, W>) : (Wars w,,—1) 


Then B’ is an orthogonal basis for V. 


3. Let u; = Then the set B” = {u,, u,,. . ., u,} is an orthonormal basis for V. 


o oo llhy motls = INA n 6 oats 


Wi 
llwall’ 
Moreover, span {v,, V>,. . -, V,} = span{u,, Us, . 


Rather than give a general proof of this theorem, it seems more instructive to discuss a 
special case for which you can use a geometric model. Let {v,, v,} be a basis for R?, as 
shown in Figure 5.18. To determine an orthogonal basis for R?, first choose one of the 
original vectors, say v,. Now you want to find a second vector orthogonal to v,. Figure 5.19 
shows that v, — proj, V, has this property. 


EXAMPLE 6 
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A A 
_@™2 
Pa \ 
at \ 
° 
V2 Wo —\ vw 
vi 
Pro} y,V2 
> > 
{v1, Vo} is a basis for R2. W2 = V2 — proj y,V2 
; is orthogonal to wy = yj. 
Figure 5.18 
Figure 5.19 
By letting 
= = : _ Vo ° Wi 
wi=y, and W, = V) — proj, Vy = V. — Ww), 
wi WwW, 


you can conclude that the set {w,, w5} is orthogonal. By the corollary to Theorem 5.10, it 
is a basis for R*. Finally, by normalizing w, and w,, you obtain the orthonormal basis for 
R? shown below. 


ft Fa mall 


Ilw, w)|| 


Applying the Gram-Schmidt Orthonormalization Process 


SOLUTION 


Apply the Gram-Schmidt orthonormalization process to the basis for R? shown below. 
Vv, V> 
BS4 D0 1) 
The Gram-Schmidt orthonormalization process produces 


w, =v, = (1) 


1 
Ww) 
wi° W, 


(0, 1) — 301, 1) = (-3,3). 
The set B’ = {w,, w>} is an orthogonal basis for R?. By normalizing each vector in B’, you 
obtain 


Wy — Vo — 


w, _ | _ v2 
~ Tw ah? 


os Iw 7 wal 5 3) vA 5 ; ( 2 22) 


u, 
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EXAMPLE 7 


Inner Product Spaces 


So, B” = {u,, u,} is an orthonormal basis for R?. See Figure 5.20. 
y y 
OD A.) (2 


Vo v1 


> xX t ox 


| 
a 
ae 
| 
ete 
a 


Given basis: B = {v, V>} Orthonormal basis: B” = {uj, uy} 


Figure 5.20 


REMARK: An orthonormal set derived by the Gram-Schmidt orthonormalization process 
depends on the order of the vectors in the basis. For instance, try reworking Example 6 with 
the original basis ordered as {v,, v,} rather than {v,, v>}. 


Applying the Gram-Schmidt Orthonormalization Process 


Apply the Gram-Schmidt orthonormalization process to the basis for R? shown below. 


Vv, Vv, V3 


B = {(1,1,0), (1,2, 0), (0, 1,2)} 


SOLUTION Applying the Gram-Schmidt orthonormalization process produces 
w, =v, = (1, 1,0) 
v.° Wy 3 ( 11 
= (1,2,0) — -(, 1,0) =|—-=,=,0 
Wo = V9 W, wr ( ) a ) > 
W; =; V3 ° Wi W, Va 7 W5 wW, 
wi’ WwW WwW. Wo 
1 1/2/ 11 
= (0, 1,2) — -U, 1,0 >> 9) = (0, 0, 2). 
(0.1.2) = 500, 1,0) — F5(~3.5.0) = (0.0.2) 

e set B’ = {w,, wW,, W3} is an orthogonal basis for R°. Normalizing each vector in 
Th B’ = {w,, W>, W3} i hogonal basis for R?. N lizing each in B’ 
produces 

1 2 V2 
wy == 1.0) = (220) 
Iwi V2 2° 2 
Ww, 1 ( id ) ( afd 2 
Uu, = = > ,0 = > 0 
Iwo] 1/J2\ 22 fa 


EXAMPLE 8 
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Ww; 1 
u, == 


3 = Iw, = 5 (0, 0, 2) = (0, 0, 1). 
3 


So, B” = {u,, u,, u,} is an orthonormal basis for R?. 


Examples 6 and 7 applied the Gram-Schmidt orthonormalization process to bases for R? 
and R?. The process works equally well for a subspace of an inner product space. This 
procedure is demonstrated in the next example. 


Applying the Gram-Schmidt Orthonormalization Process 


SOLUTION 


Figure 5.21 


EXAMPLE 9 


The vectors v, = (0, 1, 0) and v, = (1, 1, 1) span a plane in R?. Find an orthonormal basis 
for this subspace. 


Applying the Gram-Schmidt orthonormalization process produces 


w, =v, = (0, 1, 0) 
= Vo ° Wy 

Wo — Vo wi 
wi W, 


@.14)< ~(0, 0 = 0:9): 


Normalizing w, and w, produces the orthonormal set 


u, =—+ = (0,1,0) 
IIw, || 
_ _W2 
* — |Iw,| 
/2 3 + 
_ (v2, v2 
2 °°) 9 FF 


See Figure 5.21. 


Applying the Gram-Schmidt Orthonormalization Process (Calculus) 


Apply the Gram-Schmidt orthonormalization process to the basis B = {1, x, x7} in P,, 
using the inner product 


(p,q) = | p(x)q(x) dx. 
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SOLUTION Let B= {1,x, x7} = {vj, V5, v3}. Then you have 


w,=Vvy,=1 


W, = V> a wp=x- 5 (1) =x 
Oe 
2/3 0 
2 Bay — 0) 
=x - ; 


(In Exercises 43-46 you are asked to verify these calculations.) Now, by normalizing 
B’ = {wy,, W>, w3}, you have 


Ww, 1 1 
a Wi oe ae 

% = 4 
= W> JI" Ja 

W; a ee: a Cee 
le -Fral ) oa 


REMARK: The polynomials u,,u,, and u, in Example 9 are called the first three 
normalized Legendre polynomials, after the French mathematician Adrien-Marie 
Legendre (1752-1833). 


The computations in the Gram-Schmidt orthonormalization process are sometimes 
simpler when each vector w; is normalized before it is used to determine the next vector. 
This alternative form of the Gram-Schmidt orthonormalization process has the steps 
shown below. 


iy ee ee 
' [hwill liv 
u, = mus where w, = Vv, — (V5, U,)U, 
lw, 
Ww 
u, = lw. where w, = V3 — (V3, U,)U, — (V3, U5)U, 
3 


W, 
u, =~ Iw, whee Wh ~ Vn — (Vin u,)U, — (Vee U,,—1)U,—1 
n 
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EXAMPLE 10| _ Alternative Form of Gram-Schmidt Orthonormalization Process 


Find an orthonormal basis for the solution space of the homogeneous system of linear 
equations. 


X, +X + 7x, = 0 
2x, + x, + 2x, + 6x, = 0 


SOLUTION The augmented matrix for this system reduces as follows. 
3 1 0 7 ‘| 1 0 2. =] | 
= 
2 1 2 6 0 0 Il =2 8 0 


If you let x; = s and x, = ft, each solution of the system has the form 


xy =25 +f =2 1 
X5 2s — 8t 2 =8 
= =s + tf F 
Xs s 1 0 
X4 t 0 1 


So, one basis for the solution space is 
B= {Vj, Vo} {(=2, 2, 1, 0), (1, = 8,0; It. 


To find an orthonormal basis B’ = {u,,u,}, use the alternative form of the 
Gram-Schmidt orthonormalization process, as follows. 


vi 


Al 


1 
= =(-2,2,1 
3(—2, 2, 1,0) 


22 
- (3540) 


W, = V, — (V5, U,)U, 


fi. 80, hl BO ie ee 8 il la 
> a : a 3373’ 733 


u, 


= (-3, —4, 2, 1) 
_ Wo 
"2 Iwall 
= =e —4, 2, 1) 
/30 


-( 3 4. 2 ] 
J/30’ /30’ /30’ 30 
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SANTO) eee Exercises 


In Exercises 1-14, determine whether the set of vectors in R” is 
orthogonal, orthonormal, or neither. 


1. {(2, —4), (2, 1)} 2. {(3, —2), (—4, —6)} 
3. {(—4, 6), (5, 0)} 4. {(11, 4), (8, —3)} 
(3,5), (-3 5) 6. {(1,2),(—35)} 

. {(4, -1, 1), (-1, 0, 4), (—4, -17, -1)} 

. {(2, —4, 2), (0, 2, 4), (—10, —4, 2)} 


{( 2 4 2),( 6 /6 s\,(2 3 *)! 
eee an 6° 3° 6/\ 3’ 3° 3 
«(So 2}. 2% 4) (Sod 


11. {(2, —5, —3), (4, —2, 6)} 
12. {(—6, 3, 2, 1), (2, 0, 6, 0)} 


ont NH 


© 


a 2 2 we 11 11 
13. 0.0) o, .0},( = 3) 
2 2 ao ra ae 
f10 3/10 
14,5 —__ 0,0, —— |, (0, 0, 1,0), (0, 1,0, 0), 
10 10 
oi 5g 
a = 0 


In Exercises 15-18, determine if the set of vectors in R” is 
orthogonal and orthonormal. If the set is only orthogonal, normal- 
ize the set to produce an orthonormal set. 


15. {(—1, 4), (8, 2)} 16. {(2, —5), (10, 4)} 
17. {(V3, V3, V3), (- V2, 0, ¥2)} 
2 2 2 

18. {(— 75 15 13); (is 3 O}} 

19. Complete Example 2 by verifying that {1, x, x7, x7} is an ortho- 
normal basis for P; with the inner product (p,q) = 
Agdy + a,b, + ayby + aby. 

20. Verify that {(sin 0, cos @), (cos 6, —sin 6)} is an orthonormal 
basis for R?. 


In Exercises 21—26, find the coordinates of x relative to the ortho- 
normal basis B in R”. 


2/13 3/13\ (3/13 2/13 
21. B ; : : »x = (1, 2) 
13° 13 13° 13 


no-( S28) 22S) ccose 


5 5 5 


2s 9-[(B08) 0,1.0,(-B B)] 
10 10 10 10 
x = (2, -2, 1) 
24. B = {(1, 0, 0), (0, 1, 0), (0,0, I}, x = (3, —5, 11) 


25. B= {(2,4,0), (—4,3,0), (0,0, 1)}, x = (5, 10, 15) 


26. B= {(4,0, 13,0), ©, 1,0, 0), (-13, 0. 3, 0), (0, 0, 0, 1}, 

x = (2, -1, 4, 3) 
In Exercises 27-36, use the Gram-Schmidt orthonormalization 
process to transform the given basis for R” into an orthonormal 
basis. Use the Euclidean inner product for R” and use the vectors in 
the order in which they are shown. 


27. B = {(3, 4), (1, 0)} 28. B = {(1, 2), (—1, 0)} 

29. B = {(0, 1), (2, 5)} 30. B = {(4, —3), (3, 2)} 

31. B = {(1, —2, 2), (2, 2, 1), (2, -1, —2)} 

32. B = {(1,0, 0), (1, 1, 1), (1, 1, -1)} 

33. B = {(4, —3, 0), (1, 2, 0), (0, 0, 4)} 

34. B = {(0, 1, 2), (2, 0, 0), (1, 1, 1)} 

35. B = {(0, 1, 1), (1, 1, 0), (1, 0, 1)} 

36. B = {(3, 4, 0, 0), (—1, 1, 0, 0), (2, 1, 0, — 1), (0, 1, 1, 0)} 

In Exercises 37-42, use the Gram-Schmidt orthonormalization 
process to transform the given basis for a subspace of R” into an 


orthonormal basis for the subspace. Use the Euclidean inner prod- 
uct for R” and use the vectors in the order in which they are shown. 


37. B = {(—8, 3, 5)} 38. B = {(4, —7, 6)} 

39. B = {(3, 4, 0), (1, 0, 0)} 40. B = {(1, 2, 0), (2, 0, —2)} 
41. B = {(1, 2, —1, 0), (2, 2, 0, 1), (1, 1, —1, 0)} 

42. B = {(7, 24, 0, 0), (0, 0, 1, 1), (0, 0, 1, —2)} 


Calculus In Exercises 43-46, let B = {1, x, x*} be a basis for P, 
with the inner product 


1 
(P.q) = i P(x)q(x) dx. 

-1 
Complete Example 9 by verifying the indicated inner products. 


43. (x, 1) =0 44. (1,1) =2 
45, (x2, 1) = 3 46. (x2, x) = 0 


True or False? In Exercises 47 and 48, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


47. (a) A set S of vectors in an inner product space V is orthogonal 
if every pair of vectors in S is orthogonal. 
(b) To show that a set of nonzero vectors is a basis for R”, it is 
sufficient to show that the set is an orthogonal set. 
(c) An orthonormal basis derived by the Gram-Schmidt ortho- 
normalization process does not depend on the order of the 
vectors in the basis. 


48. (a) A set S of vectors in an inner product space V is orthonor- 
mal if every vector is a unit vector and each pair of vectors 
is orthogonal. 

(b) If a set of nonzero vectors S in an inner product space V is 
orthogonal, then S is linearly independent. 

(c) The Gram-Schmidt orthonormalization process is a proce- 
dure for finding an orthonormal basis for an inner product 
space V. 


In Exercises 49—54, find an orthonormal basis for the solution 
space of the homogeneous system of linear equations. 


49. 2x, X_ — 6x, + 2x, = 0 
X, + 2x, — 3x, + 4x, = 0 
x, X, — 3x, + 2x, = 0 
50. x, + x, — 3x, — 2x, = 90 
205 = XS x = 
3x, + xX, — 5x3 — 4x, = 0 
51. Xj FX Hy x= 0 
2X; FX — 2%, — 2x4 = 0 
52. x, Xy + x, +x, = 0 
X, — 2%, + x tay = 0 


53. x, + 3x, — 3x, =0 54. x, — 2x, +x, =0 

In Exercises 55-60, let p(x) = ay + a,x + ayx? and g(x) = 
by + b,x + bx? be vectors in P, with 

(P.q) = Agby + ab, + ayby. 


Determine whether the given second-degree polynomials form an 
orthonormal set, and if not, use the Gram-Schmidt orthonormaliza- 
tion process to form an orthonormal set. 


e+1x24+x-1 
55. —————S 


j2°- Wf 
56. {/2(x2 — 1), /2(x2 + x + 2)} 


57. {x?, x? + 2x, x2 + 2x + 1} 
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58. 
59. 


60. 


61. 


62. 


63. 


64. 


65. 


66. 


67. 
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{L, x, x7} 
{x2 — 1,x — 1} 
3x2 + 4x —4x? + 3x i 
5. 5 : 
Use the inner product (u,v) = 2u,v, + u,v, in R* and 


the Gram-Schmidt orthonormalization process to transform 
{(2, —1), (—2, 10)} into an orthonormal basis. 

Writing Explain why the result of Exercise 61 is not an 
orthonormal basis when the Euclidean inner product on R? is 
used. 

Let {u,,U,,. . 
that ||v|? = |v-u,|? + |v-uj[? +--+ |v-u,|? for any 
vector v in R". This equation is called Parseval’s equality. 


.,u,} be an orthonormal basis for R”. Prove 


Guided Proof Prove that if w is orthogonal to each vector in 
S = {v,,V>,...,V,}, then w is orthogonal to every linear 
combination of vectors in S. 

Getting Started: To prove that w is orthogonal to every linear 
combination of vectors in S, you need to show that their dot 
product is 0. 


(i) Write v as a linear combination of vectors, with arbi- 
trary scalars c,,. . . ,c,, in S. 

(ii) Form the inner product of w and v. 

(iii) Use the properties of inner products to rewrite the inner 
product (w, v) as a linear combination of the inner 
products (w, v;),i = 1,.. ., 7. 

(iv) Use the fact that w is orthogonal to each vector in S to 
lead to the conclusion that w is orthogonal to v. 

Let P be an n x n matrix. Prove that the following conditions 
are equivalent. 

(a) P~! = PT. (Such a matrix is called orthogonal.) 

(b) The row vectors of P form an orthonormal basis for R”. 

(c) The column vectors of P form an orthonormal basis 


for R”. 
Use each matrix to illustrate the result of Exercise 65. 

—1 0 0 
(a) P= 0 0 1 
0 -1 0 

/J2 W/V2 0 

(bt) P=|1/V2  -1//2 0 

0 0 1 


Find an orthonormal basis for R* that includes the vectors 


1 1 1 1 
v, =|—~,0,-—,0 and v,=|{0, ;0; " 
(5 J2 : ( f2 3) 
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68. Let W be a subspace of R”. Prove that the set shown below is a 1 0 1 
nl 4 71 
subspace of R” in W. 1 1 1 
Then prove that the intersection of W and W+ is {O}. 0 0 1 ] 0 
In Exercises 69-72, find bases for the four fundamental subspaces (pM 72. 1 —2 0 2 0 
of the matrix A shown below. =] 2 1 0 0 
_ : ‘ oO Ff 2 | 
N(A) = nullspace of A N(AT) = nullspace of A ; 
R(A) = column space of A R(AT) = column space of A? 73. Let A be an mxn HNO. : 
(a) Explain why R(A‘) is the same as the row space of A. 
Then show that M(A) = R(A7)+ and N(AT) = R(A)+. (b) Prove that N(A) C R(AT)+. 
1 4 i (c) Prove that N(A) = R(A7)+. 
(d) Prove that N(A7) = R(A)+. 
69. | 0 1 70.|}0 —2 2, 
1 0 +11 1 


EXAMPLE 1 


Mathematical Models and Least Squares Analysis 


In this section, you will study inconsistent systems of linear equations and learn how to 
find the “best possible solution” of such a system. The necessity of “solving” inconsis- 
tent systems arises in the computation of least squares regression lines, as illustrated in 
Example 1. 


Least Squares Regression Line 


Figure 5.22 


Let (1, 0), (2, 1), and (3,3) be three points in the plane, as shown in Figure 5.22. How can 
you find the line y = cg + c,x that “best fits” these points? One way is to note that if the 
three points were collinear, then the following system of equations would be consistent. 


Co + c, = 0 
Co + 2c, = 1 
Co + 3c, = 3 


This system can be written in the matrix form Ax = b, where 


1 0 
A=|1 2), b=l1l, ana x= || 
C. 
i. 3 3 : 


Because the points are not collinear, however, the system is inconsistent. Although it is 
impossible to find x such that Ax = b, you can look for an x that minimizes the norm of 
the error ||Ax — bl]. The solution 


Least Squares Problem 


Definition of 
Orthogonal Subspaces 


EXAMPLE 2 
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x= (% 


of this minimization problem is called the least squares regression line y = cy + cx. 


In Section 2.5, you briefly studied the least squares regression line and how to calculate 
it using matrices. Now you will combine the ideas of orthogonality and projection to 
develop this concept in more generality. To begin, consider the linear system Ax = b, 
where A is an m X n matrix and b is a column vector in R”. You already know how to use 
Gaussian elimination with back-substitution to solve for x if the system is consistent. If the 
system is inconsistent, however, it is still useful to find the “best possible” solution; that is, 
the value of x for which the difference between Ax and b is smallest. One way to define 
“best possible” is to require that the norm of Ax — b be minimized. This definition is the 
heart of the least squares problem. 


Given an m Xx n matrix A and a vector b in R”, the least squares problem is to find x in 
R" such that ||Ax — b]|? is minimized. 


REMARK: The term least squares comes from the fact that minimizing ||Ax — bl] is 
equivalent to minimizing ||Ax — b]]?, which is a sum of squares. 


Orthogonal Subspaces 


To solve the least squares problem, you first need to develop the concept of orthogonal 
subspaces. Two subspaces of R” are said to be orthogonal if the vectors in each subspace 
are orthogonal to the vectors in the other subspace. 


The subspaces S, and S, of R” are orthogonal if v, - v, = 0 for all v, in S, and all v, 
in S5. 


Orthogonal Subspaces 
The subspaces 
1) }1 =] 
S; = span{ | 0],] 1 and S, = span 1 
1] LO 1 


are orthogonal because the dot product of any vector in S$, and any vector in S, is zero. 
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Definition of 
Orthogonal Complement 


Notice in Example 2 that the zero vector is the only vector common to both S, and S$). 
This is true in general. If $, and S$, are orthogonal subspaces of R”, then their intersection 
consists only of the zero vector. You are asked to prove this fact in Exercise 45. 

Provided with a subspace S of R”, the set of all vectors orthogonal to every vector in S$ 
is called the orthogonal complement of S, as shown in the next definition. 


If S is a subspace of R”, then the orthogonal complement of S is the set 


S+ = {u © R’:v-u =0 for all vectors v € S}. 


The orthogonal complement of the trivial subspace {0} is all of R”, and, conversely, the 
orthogonal complement of R” is the trivial subspace {0}. In Example 2, the subspace S, is 
the orthogonal complement of S,, and the subspace S, is the orthogonal complement of 5). 
In general, the orthogonal complement of a subspace of R” is itself a subspace of R” (see 
Exercise 46). You can find the orthogonal complement of a subspace of R” by finding the 
nullspace of a matrix, as illustrated in the next example. 


EXAMPLE 3|_ Finding the Orthogonal Complement 

Find the orthogonal complement of the subspace S of R* spanned by the two column 

vectors v, and v, of the matrix A. 
1 0 
2 

A= 
1 0 
0 1 
Vv, V> 
SOLUTION A vector u © R* will be in the orthogonal complement of S if its dot product with the two 


columns of A, v, and v,, is zero. If you take the transpose of A, then you will see that the 
orthogonal complement of S consists of all the vectors u such that A7u = 0. 


A‘u=0 
x} 
F 2 1 | Xy | H 
0 0 0 1] | x; 0 
x4 


That is, the orthogonal complement of S is the nullspace of the matrix A’: 
St = N(A‘). 


Using the techniques for solving homogeneous linear systems, you can find that a possible 
basis for the orthogonal complement can consist of the two vectors 
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=2 =1 
1 0 

u, = 0 and u, = if 
0 0 


Notice that R* in Example 3 is split into two subspaces, S = span(v,,v,) and 
S+ = span(u,,u,). In fact, the four vectors v,, V,, u,, and u, form a basis for R+. Each 
vector in R* can be uniquely written as a sum of a vector from S and a vector from S+. This 
concept is generalized in the next definition. 


Definition of | Let S, and S, be two subspaces of R”. If each vector x © R” can be uniquely written as a 
Direct Sum SUM of a vector s, from S, and a vector s, from S,, x = s, + S,, then R” is the direct sum 
of S, and S,, and you can write R’ = S, @ S,. 


EXAMPLE 4 Direct Sum 


(a) From Example 2, you can see that R? is the direct sum of the subspaces 


1 1 al 
S,; = span| | 0], | 1 and S, = span 1 
1 0 1 


(b) From Example 3, you can see that R* = S @ S+, where 


1 0 —2 =] 
2 1 0 
S = span il lo and S+ = span 0" 1 
0 1 0 0 


The next theorem collects some important facts about orthogonal complements and 
direct sums. 


THEOREM 5.13 Let § be a subspace of R”. Then the following properties are true. 
Properties of 1. dim(S) + dim(S+) =n 


Orthogonal Subspaces 2. RX” = S@®S* 
3, (St =S 
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PROOF 


THEOREM 5.14 
Projection onto a 
Subspace 


1. If S = R" or S = {0}, then Property 1 is trivial. So let {v,, v,. . .,v,} be a basis for S, 
0 <t <n. LetA be the n x ¢ matrix whose columns are the basis vectors v,. Then 
S = R(A), which implies that S+ = N(A”), where A’ is at x n matrix of rank t (see Section 
5.3, Exercise 73). Because the dimension of N(A”) is n — f, you have shown that 


dim(S) + dim(S+) =t+ (n-—t) =n. 


2. If S = R" or S = {0}, then Property 2 is trivial. So let {v,, v,,. . .,v,} be a basis for 
S and let {v,.),V,..---.>V,} be a basis for $+. It can be shown that the set 
{V,, Vo. - ->Vp»Viiy+- ->V,t is linearly independent and forms a basis for R”. Let 
XERYX=cVv, +--+ tev, + e414, +: °° + ¢,Vy,. If you write v =c,v, + 

-- + ey, and w= c,,,V,,, +: + + +¢,V,, then you have expressed an arbitrary 
vector x as the sum of a vector from S and a vector from St, x = v + w. 

To show the uniqueness of this representation, assume x = v + w = V + W (where 
f denotes a vector that has all zero entries except for one, which is 1). This implies that 
vV — v= w — W. So, the two vectors ¥ — v and w — W are in both S and S!. Because 
SOS+ = {0}, you must have ¥ = v and w = W. 

3. Let v © S. Then v - u = 0 for all u © S+, which implies that v © (S)+. On the other 
hand, if v © (S“)+, then, because R” = S@S+, you can write v as the unique sum of 
the vector from S and a vector from $+, v = s + w,s © S, w € S+. Because w is in S+, 
it is orthogonal to every vector in S, and in particular to v. So, 


0=w:v=w:(s+w) 
=w-'st+w'-w 
=wew. 


This implies thatw = 0 andv=s+we=sE5S. 


You studied the projection of one vector onto another in Section 5.3. This is now gener- 
alized to projections of a vector v onto a subspace S. Because R" = S ® S+, every vector 
v in R" can be uniquely written as a sum of a vector from S and a vector from S+: 


v=v, +, vy,ES, v,€ S$. 


The vector v, is called the projection of v onto the subspace S, and is denoted by 
V, = proj;v. So, V7 = V — Vv, = V — proj.v, which implies that the vector v — proj,v is 
orthogonal to the subspace S. 

Provided with a subspace S of R”, you can use the Gram-Schmidt orthonormalization 
process to calculate an orthonormal basis for S. It is then an easy matter to compute the 
projection of a vector v onto S using the next theorem. (You are asked to prove this 
theorem in Exercise 47.) 


If {u,,u,,. . .,u,} is an orthonormal basis for the subspace S of R", and v € R", then 


projsv = (v- u,ju, + (v- uu, t+---+(v- uu, 


EXAMPLE 5 
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Projection onto a Subspace 


SOLUTION 


3 


Find the projection of the vector v = : onto the subspace S of R? spanned by the vectors 
2 
w, =|3 and w, =|0 
0 


By normalizing w, and w,, you obtain an orthonormal basis for S. 


0 
f fs 1 1 _ 3 ; 
u,, U, FTO Tio | : 
1 


/10 


Use Theorem 5.14 to find the projection of v onto S. 


projsv = (v- u,)u, + (v- u,)U, 


0 1 1 
_ 6 3 _|9 
~ Yio} VIO] * 4) 3) 4 5 
1 3 
10 5 


The projection of v onto the plane S$ is illustrated in Figure 5.23. 


Theorem 5.9 said that among all the scalar multiples of a vector u, the orthogonal 
projection of v onto u is the one closest to v. Example 5 suggests that this property is also 
true for projections onto subspaces. That is, among all the vectors in the subspace S, the 
vector proj,v is the closest vector to v. These two results are illustrated in Figure 5.24. 


v 


v a V— projyV proj sv 


Projyv u S 


V — projsv 


Figure 5.24 
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THEOREM 5.15 


Orthogonal Projection 
and Distance 


Let S be a subspace of R” and let v © R". Then, for all u € S, u # proj.v, 


llv — projsy|| < |lv — ull. 


PROOF  Letu © S,u # proj.v. By adding and subtracting the same quantity proj,v to and from the 
vector V — u, you obtain 
v — u= (v — projsv) + (proj,v — u). 
Observe that (proj,v — u) is in S and (v — proj,v) is orthogonal to S. So, (v — proj,v) and 
(proj,v — u) are orthogonal vectors, and you can use the Pythagorean Theorem (Theorem 
5.6) to obtain 
llv — ulP = |lv — projgv|P + |[projgy — ull. 
Because u # proj,v, the second term on the right is positive, and you have 
lIlv — projsvl| < |lv — ull. 
Fundamental Subspaces of a Matrix 
You need to develop one more concept before solving the least squares problem. Recall 
that if A is an m Xx n matrix, the column space of A is a subspace of R” consisting of all 
vectors of the form Ax, x © R”. The four fundamental subspaces of the matrix A are 
defined as follows (see Exercises 69-73 in Section 5.3). 
N(A) = nullspace of A N(A™) = nullspace of A? 
R(A) = column space of A R(A’) = column space of A? 
These subspaces play a crucial role in the solution of the least squares problem. 
EXAMPLE 6| Fundamental Subspaces 
Find the four fundamental subspaces of the matrix 
1 2 0 
0 0 1 
A= 
0 0 0 
0 0 0 
SOLUTION  Thecolumn space of A is simply the span of the first and third columns, because the second 


column is a scalar multiple of the first. 


projsv 


Figure 5.23 


THEOREM 5.16 
Fundamental Subspaces 
of a Matrix 


PROOF 
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R(A) = span 


The column space of A’ is equivalent to the row space of A, which is spanned by the first 
two rows. 


1 0 
R(A‘) = span| | 2},| 0 
0 1 
The nullspace of A is a solution space of the homogeneous system Ax = 0. 
=D 
N(A) = span 1 
0 


Finally, the nullspace of A’ is a solution space of the homogeneous system whose coeffi- 
cient matrix is A’. 


N(A‘) = span 


In Example 6, observe that R(A) and MA‘) are orthogonal subspaces of R*, and R(A7) 
and N(A) are orthogonal subspaces of R?. These and other properties of these subspaces are 
stated in the next theorem. 


If A is an m X n matrix, then 


1. R(A) and N(A*) are orthogonal subspaces of R”. 
2. R(A™) and N(A) are orthogonal subspaces of R”. 
SeR(ANIGIN (AG aRz 
4. R(AT) B MA) = R". 


To prove Property 1, let v © R(A) and u € N(A”). Because the column space of A is equal 
to the row space of A’, you can see that A7u = 0 implies u - v = 0. Property 2 follows from 
applying Property 1 to A’. 

To prove Property 3, observe that R(A)+ = N(A”). So, 


R" = R(A) @ R(A)= = R(A) @ NAY). 


A similar argument applied to R(A”) proves Property 4. 
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AX 


Figure 5.25 


EXAMPLE 7 


Least Squares 


You have now developed all the tools needed to solve the least squares problem. Recall that 
you are attempting to find a vector x that minimizes ||Ax — b||, where A is an m x n matrix 
and b is a vector in R’”. Let § be the column space of A: S = R(A). You can assume that b 
is not in S, because otherwise the system Ax = b would be consistent. You are looking for 
a vector Ax in S that is as close as possible to b, as indicated in Figure 5.25. 

From Theorem 5.15 you know that the desired vector is the projection of b onto S. 
Letting AX = proj,b be that projection, you can see that AX — b = proj,b — b is orthogonal 
to S = R(A). But this implies that AX — b is in R(A)+, which equals M(A’) according to 
Theorem 5.16. This is the crucial observation: AX — b is in the nullspace of A’. So, you 
have 


A™(Ak — b) = 0 
ATAK — A7b = 0 
ATAK = ATb. 


The solution of the least squares problem comes down to solving the 1 x n linear system 
of equations A7Ax = A’b. These equations are called the normal equations of the least 
squares problem Ax = b. 


Solving the Normal Equations 


SOLUTION 


Figure 5.26 


Find the solution of the least squares problem 


Ax =b 
14 0 
1 2 || - i 
Cy 
{ 3 3 


presented in Example 1. 


Begin by calculating the matrix products shown below. 
1 1 1 ; 3 6 
Ata =| lr 2t={é sal 
1 2 3 6 «14 


kt « 
vol a Gl 
lt a 


The normal equations are 


ae 


wnwro - 


ATAx = A’b 


leaded Lik 
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I which implies that the least squares 


NIwW win 


The solution of this system of equations is x = 


regression line for the data is y = 3y = 2 as indicated in Figure 5.26. 


Technolo gy Many graphing utilities and computer software programs have built-in programs for finding the least 
Note us regression line for a set of data points. If you have access to such tools, try verifying the 
result of Example 7. Keystrokes and programming syntax for these utilities/programs applicable to 
Example 7 are provided in the Online Technology Guide, available at college hmco.com/pic/ 
larsonELA6e. 


REMARK: For anm xX n matrix A, the normal equations form an n x n system of linear 
equations. This system is always consistent, but it may have an infinite number of solutions. 
It can be shown, however, that there is a unique solution if the rank of A is n. 


The next example illustrates how to solve the projection problem from Example 5 using 
normal equations. 


EXAMPLE 8| Orthogonal Projection onto a Subspace 


1 
Find the orthogonal projection of the vector b = | | | onto the column space S of the matrix 
0 2 
A=|3 0}. 
1 0 


SOLUTION To find the orthogonal projection of b onto S, first solve the least squares problem Ax = b. 
As in Example 7, calculate the matrix products A7A and A’b. 


2 
1 1 
Ata =|) 3 0 -("5 4 
2 0 0 0 4 


av =[° 3 
2 0 0 


Woe Se RF WO 
oO 
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EXAMPLE 9 


The normal equations are 


ATAx = A’b 
Po allel] 
0 4] Lx, 2/ 


The solution of these equations is easily seen to be 


-EI-[h 


Finally, the projection of b onto S is 
0 2 
Ax =|3 0 
1 


which agrees with the solution obtained in Example 5. 


Ss |) 
lI 
(WIG MISO ae 


Mathematical Modeling 


Least squares problems play a fundamental role in mathematical modeling of real-life 
phenomena. The next example shows how to model the world population using a least 
squares quadratic polynomial. 


World Population 


SOLUTION 


Table 5.1 shows the world population (in billions) for six different years. (Source: U.S. 
Census Bureau) 


TABLE 5.1 


Year 1980 1985 1990 1995 2000 =. 2005 


Population (y) 4.5 4.8 53 5.7 6.1 6.5, 


Let x = 0 represent the year 1980. Find the least squares regression quadratic polyno- 
mial y = cy + cx + Cox’ for these data and use the model to estimate the population for 
the year 2010. 


By substituting the data points (0, 4.5), (5, 4.8), (10, 5.3), (15, 5.7), (20, 6.1), and (25, 6.5) 
into the quadratic polynomial y = cy + c,x + cx, you obtain the following system of 
linear equations. 
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Co = 45 
Co +t 5c, + 25c, = 4.8 
Co + 10c, + 100c, = 5.3 
Cy + 15e, + 225¢, = 5.7 
Co + 20c, + 400c, = 6.1 
Co + 25c, + 625c, = 6.5 


This produces the least squares problem 


Ax =b 
1 0 0 4.5 
1 5 25 4.8 
1 10 100}|°|  |53 
1 15 225}/%|~ |57 
1 20 400 | L? 6.1 
1 25 625 6.5 


The normal equations are 


ATAx = A’b 
6 75 1375 | | co 32.9 
75 1375 = 28,125} }c,| =} 447 


1375 28,125 611,875] Lc, 8435 


and their solution is 


ra 
II 
i 


4.5 
=~ | 0.08 |. 
0 


Note that c, ~ 0. So, the least squares polynomial for these data is the linear polynomial: 
y=45 + 0.08x. 


Evaluating this polynomial at x = 30 gives the estimate of the world population for the year 
2010: 


y = 4.5 + 0.08(30) ~ 6.9 billion. 


Least squares models can arise in many other contexts. Section 5.5 explores some appli- 
cations of least squares models to approximation of functions. In the final example of this 
section, a nonlinear model is used to find a relationship between the period of a planet and 
its mean distance from the sun. 
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EXAMPLE 10 


Inner Product Spaces 


Application to Astronomy 


Technology 
Note 


You can use a computer software 
program or graphing utility with 

a built-in power regression 
program to verify the result of 
Example 10. For example, using 
the data in Table 5.2 and a 
graphing utility, a power fit 
program would result in an 
answer of (or very similar to) 

y = 1.00042x'49954. Keystrokes 
and programming syntax for 
these utilities/programs applicable 
to Example 10 are provided in the 
Online Technology Guide, 
available at college. hmco.com/ 
pic/larsonELA6e. 


Table 5.2 shows the mean distances x and the periods y of the six planets that are closest to 
the sun. The mean distance is given in terms of astronomical units (where the Earth’s mean 
distance is defined as 1.0), and the period is in years. Find a model for these data. (Source: 
CRC Handbook of Chemistry and Physics) 


TABLE 5.2 

Planet Mercury Venus Earth Mars Jupiter Saturn 
Distance, x 0.387 0.723 1.0 1.523 5.203 9.541 
Period, y 0.241 0.615 1.0 1.881 11.861 29.457 


If you plot the data as shown, they do not seem to lie in a straight line. By taking the 
logarithm of each coordinate, however, you obtain points of the form (In x, In y), as shown 
in Table 5.3. 


TABLE 5.3 

Planet Mercury Venus Earth Mars Jupiter Saturn 
In x —0.949 0.324 0.0 0.421 1.649 2.256 
Iny —1.423 -0.486 0.0 0.632 2.473 3.383 


Figure 5.27 shows a plot of the transformed points and suggests that the least squares 
regression line would be a good fit. Using the techniques of this section, you can find that 
the equation of the line is 


Iny = 3Inx or y= 


Iny 


Iny=3Inx 


Saturn 


Jupiter 


| > Inx 


Figure 5.27 


Section 5.4 Mathematical Models and Least Squares Analysis 333 


SANTO) eee Exercises 


In Exercises 1—4, determine whether the sets are orthogonal. 


2| [0 =] 
1. S, = span 1}, | 1 S, = span | 2 
-1 1 0 
=3 2] [0 
2. S$; = span 0 S, = spany| 1 |, F 
1 6} [0 
1 =1 0 
1 1 2 
3. S, = span 1 S, = span ip F 
1 1 0 
0 0 3 0 
4. S; = span i 7 S, = span i : 
2 1 Of |= 2 
1} LL =2 0 2 


In Exercises 5—8, find the orthogonal complement S+. 


5. Sis the subspace of R? consisting of the xz-plane. 


6. Sis the subspace of R° consisting of all vectors whose third and 
fourth components are zero. 


1] [0 0 
7. S = span =| : 8. S = span 

0} | 0 

0} Ll 1 


9. Find the orthogonal complement of the solution of Exercise 7. 


10. Find the orthogonal complement of the solution of Exercise 8. 


In Exercises 11-14, find the projection of the vector v onto the 
subspace S. 


0 0 1 
0 1 0 
11. S= _ 
S = span ib dalf Vv 1 
1 1 1 
=i 0) | 0 1 
2 0} |0 1 
12. S= 5 , , = 
S = span 0 itlo v 1 
0 0} L1 1 


14. S = span 


> 


WN 


0 2 
13. S = spanj| 0], i) v=1]3 
1 
0 
1 
—1 
0 


ee 
< 
ll 


4 


In Exercises 15 and 16, find the orthogonal projection of 
b =[2 —2 1]" onto the column space of the matrix A. 


1 2 0 2 
15. A =| 0 1 16. A =] 1 1 
1 1 1 3 


In Exercises 17—20, find bases for the four fundamental subspaces 
of the matrix A. 


o-<=b i 
i 2 3 
v.A=[5 | 1%.A=]1 2 O 
1 &t 4 
1 0 0 1 
geal", © 2 4 
i: « +r 4 
i 2 2% 3 
a | 
cash. 2 
i t¢ @ 
1 0 1 


In Exercises 21—26, find the least squares solution of the system 
Ax = b. 


2 1 2 
21.A=/1 2 b=] 0 

1 1 =3 

0 1 =] 
22. A=] 1 0 b=|-—1 

1 2 3 

1 0 1 4 

1 1 1 =1 
23.A =|) I I b= 0 

1 1 0 1 


334 = Chap 
1 
1 
24. A = 
0 
1 
0 
1 
25.A =| -1 
1 
0 
0 
1 
26. A =| 2 
1 
0 
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=f i 2 
1 1 fil 
1 1 >= Io 
0 1 5 
2 0 0 
1 0 1 
0 1 b=| 0 
1 1 0 
0 1 1 
>, J 1 
1 -1 0 
i- 0 b=] 1 
i 4 =] 
2 -1 0 


In Exercises 27—32, find the least squares regression line for the 
data points. Graph the points and the line on the same set of axes. 


- (~1, 1), (1, 0), (3, —3) 
~ (1, 1), (2, 3), (4, 5) 


27 
28 
29 
30. 
31 
32 


. (-2, -1), 
. (—3, —3), 


(—1, 0), (1, 0), (2, 2) 
(—2, —2), (0, 0), (1, 2) 


. (—2, 1), (-1, 2), (0, 1), C1, 2), (2, 1) 
. (—2, 0), (-1, 2), (0, 3), (1, 5), (2, 6) 


In Exercises 33-36, find the least squares quadratic polynomial for 
the data points. 


. (0, 0), (2, 2), (3, 6), (4, 12) 

. (6:2), (1, 3), (2,3), G4) 

2.0, E1,6,6,.11, 05,055 
(2,6), (1,5), (0,2), 2), 2, 1) 


33 
3 
35 
36 


37 


= 


. The table 


shows the annual sales (in millions of dollars) for 


Advanced Auto Parts and Auto Zone for 2000 through 2007. 
Find an appropriate regression line, quadratic regression 
polynomial, or cubic regression polynomial for each company. 
Then use the model to predict sales for the year 2010. Let t 
represent the year, with tf = 0 corresponding to 2000. (Source: 
Advanced Auto Parts and Auto Zone) 


Year 2000 2001 2002 2003 
Advanced 2288 2518 3288 3494 
Auto Parts Sales, y 

Auto Zone Sales, y 4483 4818 5326 5457 


38. 


39. 


40. 


Year 2004 2005 2006 2007 
Advanced 3770 4265 4625 5050 
Auto Parts Sales, y 

Auto Zone Sales, y 5637 5711 5948 6230 


The table shows the numbers of doctorate degrees y awarded in 
the education fields in the United States during the years 2001 
to 2004. Find the least squares regression line for the data. Let t 
represent the year, with tf = 1 corresponding to 2001. (Source: 
U.S. National Science Foundation) 


ear 2001 2002 + 2003 +~©=—- 2004 
D 7 

OOO 6337 GAR. <662T° «6635 
degrees, y 


The table shows the world carbon dioxide emissions y (in 
millions of metric tons) during the years 1999 to 2004. Find the 
least squares regression quadratic polynomial for the data. Let t 
represent the year, with tf = —1 corresponding to 1999. 
(Source: U.S. Energy Information Administration) 


Year 1999 2000 2001 2002 2003 2004 


CO, y 6325 6505 6578 6668 6999 7376 


The table shows the sales y (in millions of dollars) for Gateway, 
Incorporated during the years 2000 to 2007. Find a least squares 
regression quadratic polynomial that best fits the data. Let t 
represent the year, with tf = 0 corresponding to 2000. (Source: 
Gateway Inc.) 


Year 2000 2001 2002 2003 
Sales, y 9600.6 6079.2 4171.3 3402.4 
Year 2004 2005 2006 2007 
Sales, y 3649.7 3854.1 4075.0 4310.0 


9) 41. 


iM 
~ € 
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The table shows the sales y (in millions of dollars) for Dell 
Incorporated during the years 1996 to 2007. Find the least 
squares regression line and the least squares cubic regression 
polynomial for the data. Let t represent the year, with t = —4 
corresponding to 1996. Which model is the better fit for the 
data? Why? (Source: Dell Inc.) 


Year 1996 1997 1998 1999 
Sales, y 7159 12,327 18,243 25,265 
Year 2000 2001 2002 2003 
Sales, y 31,888 31,168 35,404 41,444 
Year 2004 2005 2006 2007 
Sales, y 49,205 55,908 58,200 61,000 


. The table shows the net profits y (in millions of dollars) for Polo 


Ralph Lauren during the years 1996 to 2007. Find the least 
squares regression line and the least squares cubic regression 
polynomial for the data. Let t represent the year, with t = —4 
corresponding to 1996. Which model is the better fit for the 
data? Why? (Source: Polo Ralph Lauren) 


Year 1996 1997 1998 1999 
Net Profit, y | 81.3 120.1 125.3 147.5 
Year 2000 2001 2002 2003 
Net Profit, y | 166.3 168.6 183.7 184.4 
Year 2004 2005 2006 2007 
Net Profit, y | 257.2 308.0 385.0 415.0 


True or False? 
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In Exercises 43 and 44, determine whether each 


statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


43. 


44. 


45. 


46. 


47. 
48. 


49. 


(a) If S, and S, are orthogonal subspaces of R”, then their 
intersection is an empty set. 

(b) If each vector v © R” can be uniquely written as a sum of a 
vector s, from S, and a vector s, from S,, then R” is called 
the direct sum of S, and S,. 

(c) The solution of the least squares problem consists essen- 
tially of solving the normal equations—that is, solving the 
n x n linear system of equations A7Ax = A’b. 


(a) If A is an m x n matrix, then R(A) and N(A’) are ortho- 
gonal subspaces of R”. 
(b) The set of all vectors orthogonal to every vector in a 


subspace S is called the orthogonal complement of S. 

(c) Given an m Xx n matrix A and a vector b in R”, the least 
squares problem is to find x in R” such that ||Ax — b||? is 
minimized. 

Prove that if S, and S, are orthogonal subspaces of R”, then their 

intersection consists only of the zero vector. 


Prove that the orthogonal complement of a subspace of R” is 
itself a subspace of R”. 


Prove Theorem 5.14. 
Prove that if S, and S, are subspaces of R” and if R’ = S,® S;, 
then S$, S, = {0}. 


Writing Describe the normal equations for the least squares 
problem if the m x n matrix A has orthonormal columns. 
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Definition of Cross Product 
of Two Vectors 


EXAMPLE 1 


5.5 | Applications of Inner Product Spaces 


The Cross Product of Two Vectors in Space 


Many problems in linear algebra involve finding a vector orthogonal to each vector in a set. 
Here you will look at a vector product that yields a vector in R? orthogonal to two vectors. 
This vector product is called the cross product, and it is most conveniently defined and 
calculated with vectors written in standard unit vector form. 


V = (v1, V5, V3) = Vyb + Vj + 13K 


Let u = uw,i + u,j + uk and v = v,i + v,j + vk be vectors in R3. The cross product 
of u and v is the vector 


UX V = (UyV3 — UV2)i — (u,v3 — U3V,)j + (4yv, — uQv,)k. 
REMARK: The cross product is defined only for vectors in R*. The cross product of two 
vectors in R? or of vectors in R”,n > 3, is not defined here. 


A convenient way to remember the formula for the cross product u x v is to use the 
determinant form shown below. 


ij k 
UuUXxXV=|U, Uy Uy, <— += Components of u 
Vi Vo V3 <== Components of v 


Technically this is not a determinant because the entries are not all real numbers. 
Nevertheless, it is useful because it provides an easy way to remember the cross product 
formula. Using cofactor expansion along the first row, you obtain 


u u Uu Us|, u Uu 
“evel”? 3 1 yj + 1 2Nk 


Vy V3 Vv, V3 Vp Vy 


= (usv3 U3V>)i (u,v; U3V)j + (u,V> ~ UnV)k, 


which yields the formula in the definition. Be sure to note that the j-component is preceded 
by a minus sign. 


Finding the Cross Product of Two Vectors 


Provided that u = i — 2j + k and v = 3i + j — 2k, find 


(a) ux Vv. (b) Vv XU. (c) VX Vv. 
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i j k 
SOLUTION. (a)uxv=]l —2 1 
3 l -=2 
HM _|-2 i} - |} + |! “hk 
1. =2 3 =2 3 1 
Simulation = 31 + 5j + 7k 
To explore this concept further with : . 
an electronic simulation and for 1 J k 
keystrokes and programming syntax (b) vx u= ]3 I. =2 
for specific graphing utilities and 1: =? 1 
computer software programs 
: +: 1. =2); 3 =2 3 1 
applicable to Example 1, please visit = i- | | j+ | c 
college.hmco.com/piclarsonELA6e. =2 1 1 1 1 —2 
Similar exercises and projects are = —3i — 5j — 7k 


also available on this website. 


i j k 
(c) VX v= |3 1 -2 
3 | -=2 
1 —2), 3. =2). 3 
; ~3li- sie h ilk 


= Oi + Oj + Ok =0 


Some graphing utilities and computer software programs have vector capabilities that include finding a 
cross product. For example, on a graphing utility, you can verify u x vin Example 1(a) and it could 
appear as shown below. Keystrokes and programming syntax for these utilities/programs applicable to 
Example 1(a) are provided in the Online Technology Guide, available at college.hmco.com/pic/ 
larsonELA6e. 


Technology 
Note 


VECTOR: L VECTOR: U orosscl, Wy 
ei=1 e1=5 
ep=72 e2=1 
es=1 e3=-2 
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The results obtained in Example | suggest some interesting algebraic properties of the 
cross product. For instance, 


uxv=—(v xu) and vxv=0. 


These properties, along with several others, are shown in Theorem 5.17. 


THEOREM 5.17 — If u, v, and w are vectors in R? and c is a scalar, then the following properties are true. 
Algebraic Properties 
of the Cross Product 


louxv=-—(vxu) 

2. ux (v + w) = (u x v) + (u x w) 
3. clu x v) = cux v=ux cv 
4,.ux0=0xu=0 
5.uxu=0 

6. u- (vx w) =(uxv)-w 


PROOF The proof of the first property is shown here. The proofs of the other properties are left to 
you. (See Exercises 40—44.) Let u and v be 


u = wit uj + uk 
and 
vV=vit vj + v3k. 


Then u X vis 


uxXV= lu, UW Uy, 


Vi Vo V3 


= (UyV3 — U3Vz)i — (UyV3 — U3V,)j + (u,v. — unVv,)k, 


and v x wis 


ij k 
vxu=|¥, Vv. V3 
UU; UU, Uy 


= (v,U, — V3Uy)i — (vu, — v34,)j + (Vu, — vu,)k 


= —(Uyv3 — U3Vz)i + (uyV3 — U3V,)j — (uv. — Uv, )k 


—(v x u). 


Property | of Theorem 5.17 tells you that the vectors u x v and v x u have equal 
lengths but opposite directions. The geometric implication of this will be discussed after 
some geometric properties of the cross product of two vectors have been established. 


THEOREM 5.18 
Geometric Properties of the 
Cross Product 


PROOF 
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If u and v are nonzero vectors in R?, then the following properties are true. 


1. u x vis orthogonal to both u and vy. 
2. The angle @ between u and v is given by 


lu x v|| = [lull [vil sin 6. 


3. wu and v are parallel if and only if u x v = 0. 
4. The parallelogram having u and v as adjacent sides has an area of ||u x v|l. 


The proof of Property 4 follows. The proofs of the other properties are left to you. (See 
Exercises 45—47.) To prove Property 4, let u and v represent adjacent sides of a parallelo- 
gram, as shown in Figure 5.28. By Property 2, the area of the parallelogram is 


Base Height 


Area = |ull||v|| sin 6 = |lu x y|l. 


Figure 5.28 


Property | states that the vector u x v is orthogonal to both u and v. This implies that 
u x v (and v x u) is orthogonal to the plane determined by u and v. One way to remem- 
ber the orientation of the vectors u, v, and u x v is to compare them with the unit vectors 
i, j, and k, as shown in Figure 5.29. The three vectors u, v, and u x v form a right-handed 
system, whereas the three vectors u, v, and v x u form a left-handed system. 


This is the plane 
determined by 
u and v. 


xy-plane 


Right-handed 
Systems 


Figure 5.29 
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Figure 5.30 


Inner Product Spaces 
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EXAMPLE 3 


EXAMPLE 2| _ Finding a Vector Orthogonal to Two Given Vectors 
Find a unit vector orthogonal to both 
u=i-4j+k 
and 
v = 2i + 3j. 
SOLUTION From Property 1 of Theorem 5.18, you know that the cross product 
‘ i j k 
4 (3,2, 11) uxv=/l —-4 1 
2 3 0 


= —3i+ 2j + 11k 
is orthogonal to both u and v, as shown in Figure 5.30. Then, by dividing by the length of 
u x V, 
Ju x vi] = /(—3)? + 2? + 11? 
= /134, 


you obtain the unit vector 


uxv 3 — 2 aa 11 k 
i , 
Juxvl J134' Ji344” /134 
which is orthogonal to both u and vy, as follows. 
( 3 2 11 
134’ /134’ /134 


( 3 2 11 
/134 ./134 /134 


)-a, 4,1) =0 


)-@23,0=0 


Finding the Area of a Parallelogram 


Find the area of the parallelogram that has 
u= —3i+4j+k 

and 
v= —2j + 6k 


as adjacent sides, as shown in Figure 5.31. 


SOLUTION 
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The area of the parallelogram is given by 


lluxvll= 1036. 


Figure 5.31 


From Property 4 of Theorem 5.18, you know that the area of this parallelogram is ||u x v\|. 
Because 


ijk 
uxv=|-3 4. 1| = 261+ 18j + 6k, 
0-2 6 


the area of the parallelogram is 


ju x vl] = /26 + 18? + & = ./1036 ~ 32.19. 


Least Squares Approximations (Calculus) 


Many problems in the physical sciences and engineering involve an approximation of a 
function f by another function g. If fis in C[a, b] (the inner product space of all continu- 
ous functions on [a, b]), then g usually is chosen from a subspace W of Cla, b]. For 
instance, to approximate the function 


fx) =e, Osx <1, 


you could choose one of the following forms of g. 


342 Chapter 5 Inner Product Spaces 


Figure 5.32 


Definition of 
Least Squares 
Approximation 


EXAMPLE 4 


1. g(x) = ao tax, OSxs1 Linear 
2. 20) = Pan ox, 0= e241 Quadratic 
3. g(x) = ay + a,cosx +a,sinx, O<x<1 Trigonometric 


Before discussing ways of finding the function g, you must define how one function can 
“best” approximate another function. One natural way would require the area bounded by 
the graphs of f and g on the interval [a, b], 


b 
Area = i | f(x) — g(x)| dx, 
a 
to be a minimum with respect to other functions in the subspace W, as shown in Figure 


5.32. But because integrands involving absolute value are often difficult to evaluate, it is 
more common to square the integrand to obtain 


i [ f(x) — g(x) P dx. 


With this criterion, the function g is called the least squares approximation of f with 
respect to the inner product space W. 


Let f be continuous on [a, b], and let W be a subspace of C[a, b]. A function g in W is 
called a least squares approximation of f with respect to W if the value of 


= i Hie =A 


is a minimum with respect to all other functions in W. 


REMARK: If the subspace W in this definition is the entire space C[a, b], then 
g(x) = f(x), which implies that J = 0. 


Finding a Least Squares Approximation 


SOLUTION 


Find the least squares approximation g(x) = ay + a,x for 
f(x) =e*, O<x<1. 


For this approximation you need to find the constants a, and a, that minimize the value of 


i [ Lf) — g(x)]? dx 


1 
~ [ (eo = Gn. = ax) dx, 
0 
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Evaluating this integral, you have 


1 
I= [ (e* — dy — a,x)? dx 
0 
1 


= [ (e?* — 2age* — 2a,xe* + aj + 2aya,x + atx?) dx 
0 


1 31 
oe 2aye* — 2aye*(x — 1) + agx + aga,x? + at | 
0 


1 
=—(2 = 1) = 2a,(e = 1) — 2a an aga + 3a 
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Now, considering / to be a function of the variables a) and a,, use calculus to determine the 


values of a, and a, that minimize /. Specifically, by setting the partial derivatives 


al 

— =2a, —-2e + 2+ 4, 
ddp 

ol 2 

— = a) + -a, — 2 

da, 3 


equal to zero, you obtain the following two linear equations in dy and ay. 


2a) + a, = 2(e — 1) 
3d) + 2a, = 6 


The solution of this system is 
dy = 4e -10~ 0.873 and a, = 18 — 6e ~ 1.690. 
So, the best linear approximation of f(x) = e* on the interval [0, 1] is 
g(x) = 4e — 10 + (18 — 6e)x 
= 0.873 + 1.690x. 
Figure 5.33 Figure 5.33 shows the graphs of f and g on [0, 1]. 


g(x) = 0.873 + 1.690x 


Of course, the approximation obtained in Example 4 depends on the definition of the 
best approximation. For instance, if the definition of “best” had been the Taylor polynomial 


of degree I centered at 0.5, then the approximating function g would have been 
g(x) = f(0.5) + f(0.5)(x — 0.5) 
= e095 + e5(x —, 0.5) 
0.824 + 1.649x. 


N 


Moreover, the function g obtained in Example 4 is only the best /inear approximation of 
f (according to the least squares criterion). In Example 5 you will find the best quadratic 


approximation. 
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EXAMPLE 5|_ Finding a Least Squares Approximation 
Find the least squares approximation g(x) = dy + a,x + ax? for 
f(xy) =e%, O<x<l. 
SOLUTION 


g(x) = 1.013 + 0.851x + 0.839x2 


f(x) =e* 


Figure 5.34 


For this approximation you need to find the values of do, a,;, and a, that minimize the 
value of 


l= i Lf) — g(a) P dx 


1 
-[e ay > Gin — ax ds 
0 


1 


= ae? = 1) + 241 = 2) + 24,0 =e) 
2 1 1 1 
+ aj + aga, + 340% + 71% + 3a + 502 2a). 


Integrating and then setting the partial derivatives of J (with respect to dp, a,, and a,) equal 
to zero produces the following system of linear equations. 


6a) + 3a, + 2a, = 6(e — 1) 
6a) + 4a, + 3a, = 12 
20a y + 15a, + 12a, = 60(e — 2) 


The solution of this system is 

dy = —105 + 39e = 1.013 
588 — 2l6e ~ 0.851 
—570 + 210e ~ 0.839. 


ay, 


a 
So, the approximating function g is 

g(x) ~ 1.013 + 0.851x + 0.839x?. 
The graphs of f and g are shown in Figure 5.34. 


The integral J (given in the definition of the least squares approximation) can be expressed 
in vector form. To do this, use the inner product defined in Example 5 in Section 5.2: 


(f,g) = [ rove dx. 


With this inner product you have 


a [ [f() — g(x) P dx = (f — 8,f — 8) = Ilf - gl? 


THEOREM 5.19 
Least Squares 
Approximation 


PROOF 
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This means that the least squares approximating function g is the function that minimizes 
\|,f — g||? or, equivalently, minimizes || f — g||. In other words, the least squares approxima- 
tion of a function f is the function g (in the subspace W) closest to fin terms of the inner 
product ( f, g). The next theorem gives you a way of determining the function g. 


Let f be continuous on [a, b], and let W be a finite-dimensional subspace of C[a, b]. The 
least squares approximating function of f with respect to W is given by 


eh Ww Go WW We, 


where B = {w,, W5,. . ., W,} is an orthonormal basis for W. 


To show that g is the least squares approximating function of f, prove that the inequality 


If—- sl <lf-wl 
is true for any vector w in W. By writing f — g as 
Pr 8a f Wa HAG Wag = © 82 = Es 


you can see that f — g is orthogonal to each w,, which in turn implies that it is orthogonal 
to each vector in W. In particular, f — g is orthogonal to g — w. This allows you to apply 
the Pythagorean Theorem to the vector sum 


fo wea lio ew) 
to conclude that 

lf — wl? = lf - gl? + Ile — wIP. 
So, it follows that || f — g|? < ||f—- w 


2, which then implies that || f — gl| < ||f— wi]. 


Now observe how Theorem 5.19 can be used to produce the least squares approximation 
obtained in Example 4. First apply the Gram-Schmidt orthonormalization process to the stan- 


dard basis {1, x} to obtain the orthonormal basis B = {1, J3(2x — Ne Then, by Theorem 
5.19, the least squares approximation for e* in the subspace of all linear functions is 


g(x) = (e%, 1)(1) + (6%, V3(2x — 1))V3(2x — 1) 
= [ er dx + /3(2x — »| /3e%(2x — 1) dx 


1 


1 
= [ e*dx + 3(2x — » | e*(2x — 1) dx 
0 


=(e — 1) + 3(2x — 1)B - e) 
= 4e — 10 + (18 — 6e)x, 


which agrees with the result obtained in Example 4. 
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EXAMPLE 6|_ Finding a Least Squares Approximation 


Find the least squares approximation for f(x) = sinx,0 < x < 7, with respect to the 
subspace W of quadratic functions. 


SOLUTION To use Theorem 5.19, apply the Gram-Schmidt orthonormalization process to the standard 
basis for W, {1, x, x2}, to obtain the orthonormal basis 


B = {W,, W>, Ws} 
Lae wt as 
- |e 72 ~ 1), a6 


The least squares approximating function g is 


g(x) = (f, w))w, + (f, w.)w, + (f, W3)W3, 


and you have 


(f = Fa] ‘sin d. ee 
> Wi Tals x dx Te 
(f. Wo) - 4 / sin x(2x — tt) dx = 0 


67x + 7. 


5 T 
(f, W3) = =e sin x(6x2 — 67x + a?) dx 


_ 2V5 (9 
= ia 12). 


So, g is 
2  10(a? — 12 
g(x) =— + (a : ) (6x2 67x + 777) 
7 7 
= —0.4177x? + 1.3122x — 0.0505. 
Figure 5.35 The graphs of f and g are shown in Figure 5.35. 


Fourier Approximations (Calculus) 


You will now look at a special type of least squares approximation called a Fourier 
approximation. For this approximation, consider functions of the form 


a 
g(x) aa cosx+:++-+a,cosnx+b,sinx +--+ ++ b,sinnx 


in the subspace W of C[0, 27] spanned by the basis 


S = {1, cos x, cos 2x,. . ., cos mx, sin.x, sin 2x,. . ., sin mx}. 
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These 2n + 1 vectors are orthogonal in the inner product space C[0, 277] because 
27 


(f.gv= | fg) dx =0, f#e, 


as demonstrated in Example 3 in Section 5.3. Moreover, by normalizing each function in 
this basis, you obtain the orthonormal basis 


B= {Wo Wy... 6 Was Waa qes + +> Wont 
| 1 1 i oe i. | 
=) COS X,. . .,— = cos nx, —= sinx,. . .,—= sin nxf. 
Sle la St we Jt 


With this orthonormal basis, you can apply Theorem 5.19 to write 


g(x) = ce Wo) Wo os (fs W))W, a (f, Won) Won 
The coefficients dy, a,,. - -,4,,5,,. . .,b, for g(x) in the equation 
a 
g(x) = a +a,cosx+-:-+-+a,cosnxt+b,sinx +---+b, sinnx 


are shown by the following integrals. 


0 = (fe Wo) em = [re vail n F(x) dx 


— Pate a 7) cosa 


= (f, w,) = = eee = + f(x) cos nx dx 
T Jo 


F wah fF 


ai Wnt) -+["rw4 sin x dx = ae sin x dx 


. 1 . 
be Nog? = sin nx dx = — f(x) sin nx dx 
0 


| 
= f(x) 

Var JS1Jo 
The function g(x) is called the nth-order Fourier approximation of f on the interval 


[0, 27]. Like Fourier coefficients, this function is named after the French mathematician 
Jean-Baptiste Joseph Fourier (1768-1830). This brings you to Theorem 5.20. 
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THEOREM 5.20 
Fourier Approximation 


EXAMPLE 7| _ Finding a Fourier Approximation 


Find the third-order Fourier approximation of f(x) = x,0 < x < 27. 


SOLUTION Using Theorem 5.20, you have 
a : : ; 
g(x) = 5 + a, co8x-+ a, cos 2x + a, cos3x + b, sx + b, sin 2x + by sin 3x, 


where 


277 
1 1 
w= >| xdx = —2n? =27 
7 


Qa 
1 ; 1 ; Ke. IP 
a,=— x cos jx dx = —, cos jx + — sin jx =0 
7 TT] TT] 0 


2a 
1 1 x aa 2 
b= +f x sin jx dx = | sin = ~ cos | == sy 
TJo Cy TJ ) J 
This implies that aj = 27, a, = 0, a, = 0, a, = 0, b, = —2,b, = -$ = —1, and 
b; = —3. So, you have 


2 2 
g(x) = ae 2 sin. x — sin 2x — 3 sin 3x 


: : 2, 
Third-Order Fourier Approximation eG oe TE 3 aa 


Figure 5.36 The graphs of f and g are compared in Figure 5.36. 


EXAMPLE 8 
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In Example 7 the general pattern for the Fourier coefficients appears to be ay = 27, 
a,;=@=::+:=a 0, and 


n 


The nth-order Fourier approximation of f(x) = x is 
L., Ds 1. 
g(x) = 7 — 2{sinx + 5 Sin 2x + 3 sin 3x +++++4+-—sin nx}. 
n 


As n increases, the Fourier approximation improves. For instance, Figure 5.37 shows the 
fourth- and fifth-order Fourier approximations of f(x) = x, 0 < x < 27. 


y y 


A fx) =x nN f(x) =x 
aN 
2m 
T 
& 
{ | > xX 
tT 20 
Fourth-Order Fourier Approximation Fifth-Order Fourier Approximation 
Figure 5.37 


In advanced courses it is shown that as n— 00, the approximation error || f — g|| 
approaches zero for all x in the interval (0,27). The infinite series for g(x) is called a 


Fourier series. 


Finding a Fourier Approximation 


SOLUTION 


Find the fourth-order Fourier approximation of f(x) = |x — a|, 0 < x < 27. 


Using Theorem 5.20, find the Fourier coefficients as follows. 


1(°7 
dy = [k a| dx = 7 


(0) 


20 
a= +| |x — a| cos jx dx 
T Jo 


2(" : 
—]| (m— x) cos jx dx 
0 


T 


2 
= a — cos jm) 
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i 1 ia a 
b=—| |x — al sinjxdx =0 
27 To 
FOV=IE~El) 6 a =m, a, = 4m, a, = 0, a) = 4/9m, a = 0, b, = 0, b, = 0, by = 0; and B, = 0, 
\ which means that the fourth-order Fourier approximation of f is 
4 4 
g(x) = Dt dig A ens ae 
2 #7 on 
The graphs of f and g are compared in Figure 5.38. 
wT 2m 
ga) = + FZ cos x +g cos 3x 


Figure 5.38 


SANE Exercises 


The Cross Product of Two Vectors in Space 


In Exercises 1—6, find the cross product of the unit vectors [where 
i = (1,0, 0), j = (0, 1, 0), and k = (0, 0, 1)]. Sketch your result. 


1. jxi 2.ixj 
3. jxk 4,.kxj 
5.ixk 6. k xi 


In Exercises 7-16, find u x v and show that it is orthogonal to both 

u and v. 

= (0,1, -2), v= (1, -1,0) 

= (-1, 1,2), v= (0,1, -1) 

= (12, —3, 1), v = (-2,5, 1) 

= (-2, 1,1), v = (4, 2, 0) 

= (2, —3,1), v = (1, —2, 1) 

= (4, 1,0), v = (3, 2, —2) 

=j+t+o6k, v=2i-k 

=2i-jt+k, v=3i-j 

=i+jt+k, v=2i+j-—k 
+ 3j — 2k 


= 
— 
Se ££ £ ££ £&£& &£& £&£& ££ £ ¢€ 


16. 


=i-2j+k, v=-i 


9) In Exercises 17-24, use a graphing utility with vector capabilities to 


find u x v and then show that it is orthogonal to both u and v. 


17. u = (1,2,-1), v = (2,1,2) 
18. u = (1,2, —3), v =(—1,1,2) 


19. u= (0,1,—-1), v = (1, 2,0) 
20. u = (0,1, —2), v = (0, 1, 4) 
21.u=2i-j+k, v=i-2j+k 
22,u=3i-jt+k, v=2i¢j—k 
23. u=2i+j—k, v=i-—j+t 2k 
24. u = 41+ 2j, v=i- 4k 


In Exercises 25-28, find the area of the parallelogram that has the 
vectors as adjacent sides. 

25.u=j, v=jtk 

26.u=it+jt+k, v=jt+k 

27. u = (3,2, -1), v = (1, 2, 3) 

28. u = (2, -1,0), v = (1,2, 0) 


In Exercises 29 and 30, verify that the points are the vertices of a 
parallelogram, then find its area. 


29. (1, 1, 1), @, 3, 4), (6, 5, 2), (7, 7, 5) 
30. (2, —1, 1), (5, 1, 4), (@, 1, 1), (3, 3, 4) 


In Exercises 31-34, find u - (v x w). This quantity is called the 
triple scalar product of u, v, and w. 


31. u=i, v=j, w=k 


32, u= —-i, v= —-j, w=k 
33. u = (1,1,1), v = (2,1,0), w= (0,0, 1) 
34. u = (2,0, 1), v = (0,3, 0), w= (0,0, 1) 


35. Show that the volume of a parallelepiped having u, v, and w as 
adjacent sides is the triple scalar product |u + (v x w)]. 

36. Use the result of Exercise 35 to find the volume of the paral- 
lelepiped with u=i+j,v=j+k, and w=i+ 2k as 
adjacent edges. (See Figure 5.39.) 


Figure 5.39 


In Exercises 37 and 38, find the area of the triangle with the 
given vertices. Use the fact that the area of the triangle having u and 
V as adjacent sides is given by A = 5|lu x vl]. 


a7 (153, 5),8, 3.0.4 2;.0,5) 
38. (2, —3, 4), (0, 1, 2), (—1, 2, 0) 


39. Find the volume of the parallelepiped shown in Figure 5.40, 
with u, v, and w as adjacent sides. 


z 


(1, 0, 1) 


¥ 
Figure 5.40 


40. Prove that cu x v = c(u x v) =u X cv. 

41. Prove that u x (v + w) = (u x v) + (u x w). 
42. Prove thattux0=0xu=0. 

43. Prove that u x u = 0. 

44, Prove that u - (v x w) = (u x v) - w. 

45. Prove that u x v is orthogonal to both u and v. 


46. Prove that the angle 6 between u and v is given by 
lu x vi] = [hull [lv] sin 6. 


47. Prove that u x v = 0 if and only if u and v are parallel. 
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48. Prove Lagrange’s Identity: 
lu x v|P = |lulPllvIP — (a> vy. 
49, (a) Prove that u x (v x w) = (u- w)v — (u- v)w. 


(b) Find an example for which u x (v x w) # (u x vy) x w. 


Least Squares Approximations (Calculus) 


4) In Exercises 50-56, (a) find the linear least squares approximating 


function g for the function f and (b) use a graphing utility to graph f 

and g. 

50. f(x) =x, O< x1 51. f(xy) = Vx, 1 sx <4 

52. f(x) =e*, O<x<1 53. f(x) =e", O<x< 1 

54. f(x) = cosx, OS x< 7 

55. f(x) = sinx, 0 < x < 7/2 

56. f(x) = sinx, —7/2 <x < w/2 

In Exercises 57-62, (a) find the quadratic least squares approxi- 

mating function g for the function f and (b) graph f and g. 

57. f(x) =», OSs x<1 

58. f(x) = /x, 1 <x 

59. f(x) = sinx, OSxs7 

60. f(x) = sinx, —a/2 <x 

61. f(x) = cosx, —a/2 <x < a/2 
7 


62. f(x) = cosx, OS xs 


Ao 


Fourier Approximations (Calculus) 


In Exercises 63—74, find the Fourier approximation of the specified 
order for the function on the interval [0, 277]. 
63. f(x) = 7— x, third order 

64. f(x) = 7— x, fourth order 

65. f(x) = (x — 7), third order 

66. f(x) = (x — 7)?, fourth order 

67. f(x) =e, _ first order 

68. f(x) = e*, second order 

69. f(x) = e~*, first order 

70. f(x) = e-?*, second order 

71. f(x) = 14x, third order 

72. f(x) = 1+ x, fourth order 

73. f(x) = 2sinxcosx, fourth order 

74. f(x) = sin?x, fourth order 
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75. Use the results of Exercises 63 and 64 to find the nth-order 


Fourier approximation of f(x) = 7 — x on the interval [0, 27]. 


76. Use the results of Exercises 65 and 66 to find the nth-order 
Fourier approximation of f(x) = (x — 7)? on the interval 
[0, 277]. 


, (b) |v 


In Exercises 1-8, find (a) |lu , (c) u- vy, and (d) d(u,v). 


1. u = (1,2), v = (4,1) 

u = (—1,2), v = (2,3) 
.u=(2,1,1), v= GB,2, -1) 
.u=(1,-1, 2), v=(2,3,1) 

u = (1, —2, 0,1), v= (1, 1, —1,0) 

. u = (1, —2,2,0), v = (2, —1,0,2) 
u=(0,1,-1,1,2), v= (0,1, —-2,1,1) 
8. u = (1, —1,0,1, 1), v = (0,1, —2,2,1) 


YAaAw Pw HD 


In Exercises 9-12, find ||v|| and find a unit vector in the direction 
of v. 


9. v = (5, 3, —2) 
11. v = (1,-1,2) 


10. v = (1, —2, 1) 
12. v = (0, 2, —1) 
In Exercises 13-18, find the angle between wu and v. 
13. u = (2,2), v = (-3, 3) 
14. u= (1,—-1), v= (0,1) 


3a. 39 27 | QT 
15. u= cos Si , V=|cos —,, sin 


16. u = (cos a sin 2), v= (cos 6 , sin 6 
17. u = (10, —5, 15), v = (—2, 1, —3) 

18. u = (1,0, —3,0), v = (2, —2, 1, 1) 

In Exercises 19-24, find proj,u. 

19. u = (2,4), v = (1, —5) 

20. u = (2,3), v = (0,4) 

21. u = (1,2), v = (2,5) 

22. u = (2,5), v = (0,5) 

23. u = (0, -1,2), v = (3, 2, 4) 

24. u = (1,2, -1), v = (0, 2, 3) 
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25. For u= (2, =3 1) and v = (3, 23> 1), (a) find the inner prod- 
uct represented by (u, v) = u,v, + 2u,v, + 3u3V3, and (b) use 
this inner product to find the distance between u and v. 

26. Foru = (0, 3, 5) and v = (¢ 1,- 3), (a) find the inner product 
represented by (u,v) = 2u,v, + uv, + 2u,v3, and (b) use 
this inner product to find the distance between u and v. 


27. Verify the Triangle Inequality and the Cauchy-Schwarz 
Inequality for u and v from Exercise 25. (Use the inner product 
from Exercise 25.) 


28. Verify the Triangle Inequality and the Cauchy-Schwarz 
Inequality for u and v from Exercise 26. (Use the inner product 
given in Exercise 26.) 


In Exercises 29-32, find all vectors orthogonal to u. 
29. u = (0, —4, 3) 30. u = (1, —1, 2) 
31. u = (1, —2, 2, 1) 32. u = (0, 1, 2, —1) 
In Exercises 33-36, use the Gram-Schmidt orthonormalization 
process to transform the basis into an orthonormal basis. (Use the 
Euclidean inner product.) 
33. B = {(1, 1), 0, I} 
34, B = {(3, 4), (1, 2)} 
35. B = {(0, 3, 4), (1, 0, 0), (1, 1, 0)} 
36. B = {(0, 0, 2), (0, 1, 1), (1, 1, 1)} 
37. Let B = {(0, 2, —2), (1, 0, —2)} be a basis for a subspace of 
R?, and let x = (—1, 4, —2) be a vector in the subspace. 
(a) Write x as a linear combination of the vectors in B. That 
is, find the coordinates of x relative to B. 


(b) Use the Gram-Schmidt orthonormalization process to 
transform B into an orthonormal set B’. 


(c) Write x as a linear combination of the vectors in B’. That 
is, find the coordinates of x relative to B’. 


38. Repeat Exercise 37 for B = {(—1, 2, 2), (1, 0, 0)} and 
x = (-3,4, 4). 


Calculus In Exercises 39-42, let fand g be functions in the vector 
space C[a, b] with inner product 


b 
(fg) = | f(x)g(x) dex. 


39, Let f(x) = x and g(x) = x? be vectors in C[0, 1]. 
(a) Find (f, g). 
(b) Find ||g||. 
(c) Find d(f, g). 
(d) Orthonormalize the set B = {f, g}. 
40. Let f(x) = x + 2 and g(x) = 15x — 8 be vectors in C[0, 1]. 
(a) Find (f, g). 
(b) Find (—4f, g). 
(c) Find|| | 
(d) Orthonormalize the set B = { f, g}. 


41. Show that f(x) = /1 — x? and g(x) = 2x\/1 — x are orthog- 
onal in C[—1, 1]. 


42. Apply the Gram-Schmidt orthonormalization process to the set 
in C[— 7, 7] shown below. 


S = {1, cos x, sin x, cos 2x, sin 2x,. . ., cos nx, sin nx} 
43. Find an orthonormal basis for the following subspace of 
Euclidean 3-space. 
W = {(x,, Xp, X34): x, + x, + x, = OF 
44, Find an orthonormal basis for the solution space of the 
homogeneous system of linear equations. 
xty-—z+ w=0 
2x—-y+tzt+2w=0 


Calculus In Exercises 45 and 46, (a) find the inner product, 
(b) determine whether the vectors are orthogonal, and (c) verify 
the Cauchy-Schwarz Inequality for the vectors. 


48. fs) = 2.00) = oe oad =| slrelod 


1 
46. fo) = sat) = 4, 2) = f slate 
0 
47. Prove that if u and v are vectors in an inner product space such 
that |jul] < 1 and ||v|| < 1, then |(u, v)| < 1. 
48. Prove that if u and v are vectors in an inner product space V, then 


[ilu] — [vil] < lw vil 


49. 


50. 


51. 


52. 


53. 


54. 


55. 


56. 


57. 


58. 
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Let V be an m-dimensional subspace of R” such that m < n. 
Prove that any vector u in R” can be uniquely written in the form 
u = v + w, where v is in V and w is orthogonal to every vector 
in V. 

Let V be the two-dimensional subspace of R* spanned by 
(0, 1, 0, 1) and (0, 2, 0, 0). Write the vector u = (1, 1, 1, 1) in 
the form u = v + w, where v is in V and w is orthogonal to 
every vector in V. 


Let {u,,U,,. . .,U,,} be an orthonormal subset of R”, and let v 


be any vector in R”. Prove that 


|v? = S& -u,)’. 
i=1 
(This inequality is called Bessel’s Inequality.) 
Let {x,,%5,. . .,x,} be a set of real numbers. Use the 
Cauchy-Schwarz Inequality to prove that 


(x tx tess t+ x)? Ss nQf top +--+ 4+ x). 
Let u and v be vectors in an inner product space V. Prove 


that |ju + v|| = |lu — v|| if and only if u and v are orthogonal. 


Writing Let {u,,u,,. . .,u,,} be a dependent set of vectors 
in an inner product space V. Describe the result of applying the 
Gram-Schmidt orthonormalization process to this set. 


Find the orthogonal complement S+ of the subspace S of R? 
spanned by the two column vectors of the matrix 


1 2 
A=}2 1}. 
0 -I 
Find the projection of the vector v =[1 0 —2]' onto the 
subspace 
0| {0 
S = spany| —1], | 1 
1 1 
Find bases for the four fundamental subspaces of the matrix 
0 1 0 
A=|0 -3 0}. 
1 0 1 


Find the least squares regression line for the set of data points 


{(—2, 2), (—1, 1), (, 1), (1, 3)}- 


Graph the points and the line on the same set of axes. 
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49) Mathematical Modeling 


(RM 59. 


60. 


61. 


The table shows the retail sales y (in millions of dollars) of run- 
ning shoes in the United States during the years 1999 to 2005. 
Find the least squares regression line and least squares cubic 
regression polynomial for the data. Let t represent the year, with 
t = —1 corresponding to 1999. Which model is the better fit for 
the data? Use the model to predict the sales in the year 2010. 
(Source: National Sporting Goods Association) 


Year 1999 2000 2001 2002 
Sales, y 1502 1638 1670 1733 
Year 2003 2004 2005 
Sales, y 1802 1989 2049 


The table shows the average salaries y (in thousands of dollars) 
for National Football League players during the years 2000 to 
2005. Find the least squares regression line for the data. Let t 
represent the year, with tf = 0 corresponding to 2000. (Source: 
National Football League) 

2000 2001 


Year 2002 


Average Salary, y 787 986 1180 


Year 2003 2004 2005 


Average Salary, y 1259 1331 1440 


The table shows the world energy consumption y (in quadrillions 
of Btu) during the years 1999 to 2004. Find the least squares 
regression line for the data. Let t represent the year, witht = —1 
corresponding to 1999. (Source: U.S. Energy Information 
Administration) 


Year 1999 2000 2001 
Energy Consumption, y 389.1 399.5 403.5 
Year 2002 2003 2004 
Energy Consumption, y 409.7 425.7 446.4 


(AM 62. 


IM 63, 


M4 64. 


The table shows the numbers of stores y for the Target 
Corporation during the years 1996 to 2007. Find the least 
squares regression quadratic polynomial that best fits the data. 
Let ¢ represent the year, with t = —4 corresponding to 1996. 
Make separate models for the years 1996-2003 and 2004—2007 
(Source: Target Corporation) 


Year 1996 1997 1998 1999 2000 2001 
Number ef | vio) 4430 1182 1243 -1307—«1381 
Stores, y 
Year 2002 2003 2004 2005 2006 2007 
Numb 
i rel | 175 1553 1308 1397 1495 1610 
tores, y 


The table shows the revenues y (in millions of dollars) for 
eBay, Incorporated during the years 2000 to 2007. Find the least 
squares regression quadratic polynomial that best fits the data. 
Let ¢ represent the year, with t = 0 corresponding to 2000. 
(Source: eBay, Incorporated) 


Year 2000 2001 2002 2003 
Revenue, y 431.4 748.8 1214.1 2165.1 
Year 2004 2005 2006 2007 
Revenue, y 3271.3 4552.4 5969.7 7150.0 


The table shows the revenues y (in millions of dollars) for 
Google, Incorporated during the years 2002 to 2007. Find the 
least squares regression quadratic polynomial that best fits the 
data. Let t represent the year, with t = 2 corresponding to 2002. 
(Source: Google, Incorporated) 


Year 2002 2003 2004 
Revenue, y 439.5 1465.9 3189.2 
Year 2005 2006 2007 
Revenue, y 6138.6 10,604.9 16,000.0 


(tM 65. The table shows the sales y (in millions of dollars) for Circuit 


City Stores during the years 2000 to 2007. Find the least squares 
regression quadratic polynomial that best fits the data. Let ¢ 
represent the year, with t = 0 corresponding to 2000. (Source: 
Circuit City Stores) 


Year 2000 2001 2002 2003 
Sales, y 10,458.0 9589.8 9953.5 9745.4 
Year 2004 2005 2006 2007 
Sales, y 10,472.0 11,598.0 12,670.00 —13,680.0 


The Cross Product of Two Vectors in Space 


In Exercises 66-69, find u x v and show that it is orthogonal to 
both u and v. 

66. u = (1, 1,1), v = (1,0, 0) 

67. u = (1, -1, 1), v = (0,1, 1) 

68. u=j + 6k, v=i- 2j+k 

69. u= 2i-—k, v=i+j-—k 


70. Find the area of the parallelogram that has u = (1, 3, 0) and 
v = (1, 0, 2) as adjacent sides. 


71. Prove that |lu x v|| = |lul|||v|| if and only if u and v are 
orthogonal. 


In Exercises 72 and 73, the volume of the parallelepiped having u, 
v, and w as adjacent sides is given by the triple scalar product 
Ju : (v x w)|. Find the volume of the parallelepiped having the 
three vectors as adjacent sides. 


72. u = (1,0,0), v = (0,0, 1), w= (0, 1,0) 
73. u = (1,2,1), v = (-1,-1,0), w= (3,4, -1) 
Least Squares Approximations (Calculus) 


In Exercises 74-77, find the linear least squares approximating 
function g for the function f. Then sketch the graphs of f and g. 


74. f(x) =, -l<x<l 
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75. f(x) =», O<x <2 
76. f(x) = sin 2x, 0 <x < w/2 


77. f(x) = sinxcosx, 0 <x<7 


4) In Exercises 78 and 79, find the quadratic least squares approximat- 


ing function g for the function f. Then, using a graphing utility, graph 
fand g. 


78. f(x) = /x, OS x <1 


Fourier Approximations (Calculus) 


In Exercises 80 and 81, find the nth-order Fourier approximation of 
the function. 


80. f(x) = x?, —a7 < x S gr, first order 


81. f(x) = x, — a7 < x < am, second order 


True or False? In Exercises 82 and 83, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


82. (a) The cross product of two nonzero vectors in R? yields 
a vector orthogonal to the two given vectors that produced it. 


(b) The cross product of two nonzero vectors in R? is 
commutative. 


(c) The least squares approximation of a function f is the 
function g (in the subspace W) closest to f in terms of the 
inner product (f, g). 
83. (a) The vectors in R? u x v and v x wu have equal lengths but 
opposite directions. 


(b) If u and v are two nonzero vectors in R?, then u and v are 
parallel if and only if u x v = 0. 


(c) A special type of least squares approximation, the 
Fourier approximation, is spanned by the basis S = 
{1, cos x, cos 2x,. . ., cos nx, sin x, sin 2x,. . ., sin nx}. 
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GUN sidiwm Projects 


1 The QR-Factorization 


The Gram-Schmidt orthonormalization process leads to an important factorization of 
matrices called the QR-factorization. If A is an m x n matrix of rank n, then A can 
be expressed as the product A = QR of an m x n matrix Q and ann x n matrix R, 
where Q has orthonormal columns and R is upper triangular. 

The columns of A can be considered a basis for a subspace of R”, and the columns 
of Q are the result of applying the Gram-Schmidt orthonormalization process to this 
set of column vectors. 

Recall that in Example 7, Section 5.3, the Gram-Schmidt orthonormalization 
process was used on the column vectors of the matrix 


1 1 0 
A=|1 2 1 
0 0 2 


An orthonormal basis for R? was obtained, which is labeled here as q,, q>, 43. 
d= (222200) 
a, = (— 2/2, 2/2, 0) 
q3 = (0, 0, 1) 

These vectors form the columns of the matrix Q. 


V2/2 —~/2/2 0 
O=|V2/2 2/2 0 


0 0 1 
The upper triangular matrix R consists of the following dot products. 
Vi° Gi: Vo" G V3" Gh V2 34/2/29 2/2 
0 V2°G Y3'G|=| 9 2/22/22 
0 0 V3 ° q3 0 0 2; 


It is now an easy exercise to verify that A = QR. 


In general, if A is an m x n matrix of rank n, then the QR-factorization of A 
can be constructed if you keep track of the dot products used in the Gram-Schmidt 
orthonormalization process as applied to the columns of A. The columns of the m x n 
matrix Q are the orthonormal vectors that result from the Gram-Schmidt 
orthonormalization process. The n x n upper triangular matrix R consists of certain 
dot products of the original column vectors v, and the orthonormal column vectors q,. 
If the columns of the matrix A are denoted as v,, V,,. . ., V,, and the columns of Q 
are denoted as q,, q>, . . . , q,,, then the OR-factorization of A is as follows. 
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A=QR 
Vvi°G) VYo° G Vn? 
0 YY: 4 v4 
Lv, V6) Seal v1 = lq, qo Oise 4,1 : ¥ . 
0 0 Bereta Ai qi, 


1. Verify the matrix equation A = QR for the preceding example. 
2. Find the QR-factorization of each matrix. 


1 0 
ia ay 
G@rA= (or a A=] | 
eG 
ee 
ae 
1 
Onell ; : (eee. eee 
oe Site ue 
ia Tes ae 
1 0 0 


3. Let A = QR be the QR-factorization of the m x n matrix A of rank n. Show 
how the least squares problem can be solved using just matrix multiplication 
and back-substitution. 

4. Use the result of part 3 to solve the least squares problem Ax = b if A is the 
matrix from part 2(a)andb =[—1 1 —1]’. 


The QR-factorization of a matrix forms the basis for many algorithms of linear 
algebra. Computer routines for the computation of eigenvalues (see Chapter 7) are 
based on this factorization, as are algorithms for computing the least squares 
regression line for a set of data points. It should also be mentioned that, in 
practice, techniques other than the Gram-Schmidt orthonormalization process are 
actually used to compute the QR-factorization of a matrix. 


2 Orthogonal Matrices and Change of Basis 


Let B = {v,, V5,. . ..v,,} be an ordered basis for the vector space V. Recall that the 
coordinate matrix of a vector x = c,Vv, + c,Vv, +: - - + ¢,v, in V is the column 
vector 
Tl 
2 
[x], = : 


G 


n 
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If B’ is another basis for V, then the transition matrix P from B’ to B changes a 
coordinate matrix relative to B’ into a coordinate matrix relative to B, 


PUx]y = [xp 


The question you will explore now is whether there are transition matrices P that 
preserve the length of the coordinate matrix—that is, given P[x],,=[x],, does 


Idol = Ixdel? 


For example, consider the transition matrix from Example 5 in Section 4.7, 


Epa 


relative to the bases for R?, 

B = {(—3, 2), (4, —2)} and B= t=, 2), 2, =2)}. 
If x = (—1, 2), then [x],,=[1 0]? and [x], = Plx],,=[3 2]?. So, using the 
Euclidean norm for R?, 


Ile = 1 # V13 = [Exell 


You will see in this project that if the transition matrix P is orthogonal, then the 
norm of the coordinate vector will remain unchanged. 


The square matrix P is orthogonal if it is invertible and P~! = P’. 


1. Show that the matrix P defined previously is not orthogonal. 

cos@ —sin 6}. 

ance eae , is orthogonal. 

3. Show that a matrix is orthogonal if and only if its columns are pairwise 
orthogonal. 

4. Prove that the inverse of an orthogonal matrix is orthogonal. 

5. Is the sum of orthogonal matrices orthogonal? Is the product of orthogonal 
matrices orthogonal? Illustrate your answers with appropriate examples. 

6. What is the determinant of an orthogonal matrix? 

7. Prove that if P is an m x n orthogonal matrix, then || Px|| = ||x|| for all vectors x 
in R". 

8. Verify the result of part 7 using the bases B = {(1, 0), (0, 1)} and 


a {(- F rae alr 


2. Show that for any real number 0, the matrix 
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View Cumulative Test 


Take this test as you would take a test in class. After you are done, check your work against the 
answers in the back of the book. 


1. Given the vectors v = (1, —2) and w = (2, —5), find and sketch each vector. 
(a) Vv +w (b) 3v (c) 2v — 4w 


2. If possible, write w = (2, 4, 1) as a linear combination of the vectors V,, V>, and y;. 
v, =(1,2,0), v,=(-1,0,1), — v3 = (0,3, 0) 
3. Prove that the set of all singular 2 x 2 matrices is not a vector space. 


4. Determine whether the set is a subspace of R*. 


{Q,x + yyy): x,y © R} 


5. Determine whether the set is a subspace of R?. 
{(x, xy, y): x,y © R} 


6. Determine whether the columns of matrix A span R’. 


1 2-1 0 
{ 3: ~@ 2 
ced a a 
1 0 oO 1 


7. (a) Define what it means to say that a set of vectors is linearly independent. 
(b) Determine whether the set S is linearly dependent or independent. 
S = {(1, 0, 1, 0), (0, 3, 0, 1), (1, 1, 2, 2), (3, —4, 2, —3)} 
8. Find the dimension of and a basis for the subspace of M, , consisting of all the 3 x 3 symmetric 
matrices. 
9. (a) Define basis of a vector space. 
(b) Determine if the set is a basis for R°. 
{(1, 2, 1), (0, 1, 2), (2, 1, —3)} 
10. Find a basis for the solution space of Ax = 0 if 
1 1 0 0 
—2 =2 0 0 
0 0 1 1} 
1 1 0 0 
11. Find the coordinates [v], of the vector v = (1, 2, —3) relative to the basis 
B = {(0, 1, 1), (, 1, 1), C, 0, 1}. 
12. Find the transition matrix from the basis B = {(2, 1, 0), (1, 0, 0), (0, 1, 1)} to the basis 
B’ = {(1, 1, 2), (1, 1, 1), (0, 1, 2)}. 


13. Letu = (1, 0, 2) and v = (—2, 1, 3). 
(a) Find |lul]. (b) Find the distance between u and v. 
(c) Find u: v. (d) Find the angle 6 between u and v. 


A= 
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14. 


15. 


16. 


17. 


18. 


19. 
20. 


21. 


22. 


23. 


24. 


Find the inner product of f(x) = x? and g(x) = x + 2 from C[0, 1] using the integral 


(f.8) = [ , f (x)g(x) dx. 


Use the Gram-Schmidt orthonormalization process to transform the following set of vectors into 
an orthonormal basis for R?. 


{(2, 0, 0), (1, 1, 1), (0, 1, 2)} 


Let u = (1, 2) and v = (—3, 2). Find projyu, and graph u, v, and proju on the same set of 
coordinate axes. 
Find the four fundamental subspaces of the matrix 

0 1 1 0 


A=)-1 0 0 1}. 
1 if 1 1 


Find the orthogonal complement S+ of the set 


1 =1 
S = span| | 0}, 1 
1 0 


Use the axioms for a vector space to prove that Ov = 0 for all vectors v € V. 

Suppose that x,,. . ., X, are linearly independent vectors and y is a vector not in their span. Prove 
that the vectors x,,. . ., X,, and y are linearly independent. 

Let W be a subspace of an inner product space V. Prove that the set below is a subspace of V. 


Wt ={v EV: (v,w) =0 forall we Ww} 
Find the least squares regression line for the points {(1, 1), (2, 0), (5, —5)}. Graph the points and 


the line. 
The two matrices A and B are row-equivalent. 


2 —-4 0 1 7 11 | =2 0 0) 3 2 
A= LS =1 1 9 12 pu-|? 0) 1 0: = -—3 
=k 2 if 3. -5 16 0 0 0 1 1 7 
4 -8 | | 6 =2 0 0 0 0 0 0 
(a) Find the rank of A. 
(b) Find a basis for the row space of A. 
(c) Find a basis for the column space of A. 
(d) Find a basis for the nullspace of A. 
(e) Is the last column of A in the span of the first three columns? 
(f) Are the first three columns of A linearly independent? 
(g) Is the last column of A in the span of columns 1, 3, and 4? 
(h) Are columns 1, 3, and 4 linearly dependent? 
Let u and v be vectors in an inner product space V. Prove that ||u + v|| = ||u — v|| if and only if 


u and v are orthogonal. 


Linear 


Transformations 


6.1 Introduction to Linear CHAPTER OBJECTIVES 
Transformations 

6.2 The Kernel and Range of 
a Linear Transformation 


M@ Find the image and preimage of a function. 
@ Determine whether a function from one vector space to another is a linear transformation. 


6.3 Matrices for Linear @ Find the kernel, the range, and the bases for the kernel and range of a linear transformation 
Transformations T, and determine the nullity and rank of T. 

6.4 Transition Matrices and @ Determine whether a linear transformation is one-to-one or onto. 
Similarity ® Verify that a matrix defines a linear function that is one-to-one and onto. 

6.5 Applications of Linear ® Determine whether two vector spaces are isomorphic. 
Transformations @ Find the standard matrix for a linear transformation and use this matrix to find the image of 


a vector and sketch the graph of the vector and its image. 

Find the standard matrix of the composition of a linear transformation. 

Determine whether a linear transformation is invertible and find its inverse, if it exists. 
Find the matrix of a linear transformation relative to a nonstandard basis. 

Know and use the definition and properties of similar matrices. 


Identify linear transformations defined by reflections, expansions, contractions, shears, 
and/or rotations. 


6.1 | Introduction to Linear Transformations 


In this chapter you will learn about functions that map a vector space V into a vector space 
W. This type of function is denoted by 


T: VOW. 


The standard function terminology is used for such functions. For instance, V is called the 
domain of 7, and W is called the codomain of T. If v is in V and w is in W such that 


T(v) = w, 


then w is called the image of v under T. The set of all images of vectors in V is called the 
range of T, and the set of all v in V such that 7(v) = w is called the preimage of w. (See 
Figure 6.1 on the next page.) 
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REMARK: Fora vector 
Vv = (v1, v3,. . -,v,) in R’, it 


would be technically correct to 
use double parentheses to denote 
T(v) as T(v) =T((v,, v>,. . -,¥,))- 
For convenience, however, one 
set of parentheses is dropped, 


producing 


Tv) = T(v,, Vo. 2 + 5v ). 


daa 7) 


EXAMPLE 1 


Range 


T: V>3W W: Codomain 


Figure 6.1 


A Function from R2 into R2 


SOLUTION 


Definition of a 
Linear Transformation 


For any vector v = (v,, v5) in R?, let T: R*— R? be defined by 
T(V,, V) = (v, — 

(a) Find the image of v = (—1, 2). 

(b) Find the preimage of w = (—1, 11). 


Vo, V) + Ju 


(a) For v = (—1, 2) you have 
T(—1, 2) = (-1 — 2, -1 + 2(2)) = (-3, 3). 
(b) If T(v) = (v, — >, ¥, + 2v5) = (—1, 11), then 


iy ye Hl 
vy, + 2v, = 11. 


This system of equations has the unique solution v, = 3 and v, = 4. So, the preimage 
of (—1, 11) is the set in R? consisting of the single vector (3, 4). 


This chapter centers on functions (from one vector space to another) that preserve the 
operations of vector addition and scalar multiplication. Such functions are called linear 
transformations. 


Let V and W be vector spaces. The function 7: V— W is called a linear transformation of 
V into W if the following two properties are true for all u and v in V and for any scalar c. 
1. Tu + v) = T(u) + T(v) 

2. T(cu) = cT(u) 


A linear transformation is said to be operation preserving, because the same result occurs 
whether the operations of addition and scalar multiplication are performed before or after 
the linear transformation is applied. Although the same symbols are used to denote the 


EXAMPLE 2 
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vector operations in both V and W, you should note that the operations may be different, as 
indicated in the diagram below. 


Addition Addition Scalar Scalar 
mi in W multiplication multiplication 
5 inV inW 


T(u + v) = 7T(u) + T(v) T(cu) = cT(u) 


Verifying a Linear Transformation from R? into R? 


SOLUTION 


REMARK: A linear transfor- 
mation T: V— V from a vector 
space into itself (as in Example 
2) is called a linear operator. 


EXAMPLE 3 


Show that the function given in Example 1 is a linear transformation from R? into R?. 


T(v,, 1) = (v, — V9, Vy + 2v,) 


To show that the function T is a linear transformation, you must show that it preserves 
vector addition and scalar multiplication. To do this, let v = (vj, v) and u = (uj, uy) be 
vectors in R? and let c be any real number. Then, using the properties of vector addition and 
scalar multiplication, you have the two statements below. 
1. Because u + v = (uy, Uy) + (V4, V9) = (u, + v4, Uy + v5), you have 
T(u + v) = T(u, + v,, u> + v9) 

= ((u, + v,) — (uy + v,), (uy + v,) + 2(u, + v,)) 

= ((u; — uy) + (v, — v>),(u, + 2u5) + (v, + 2v,)) 

= (Wy — te, Uy + Qu) + (Vv, — Voy ¥, + 2¥5) 

= T(u) + 7(v). 


2. Because cu = c(u,, U5) = (cu, cu), you have 


T(cu) = T(cu,, cu) 


= (cu, — cuy, cu, + 2cu,) 
= c(uy — Uy, u, + 2u5) 
= cT(u). 


So, T is a linear transformation. 


Most of the common functions studied in calculus are not linear transformations. 


Some Functions That Are Not Linear Transformations 


(a) f(x) = sin x is not a linear transformation from R into R because, in general, 
sin(x, + x) # sinx, + sin x). 


For instance, sin[(7/2) + (a/3)] # sin(a/2) + sin(7/3). 
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Properties of 
Linear Transformations 


(b) f(x) = x? is not a linear transformation from R into R because, in general, 
(ai ae) = Ae ae. 
For instance, (1 + 2)? # 1? + 22. 
(c) f(x) = x + 1 is not a linear transformation from R into R because 
fq +e) He) 77 1 
whereas 
fy) Pie) = (ae De eS DSH ae ae 
So f(x, + X5) f(x,) a f(x). 


REMARK: The function in Example 3(c) points out two uses of the term /inear. In calcu- 
lus, f(x) = x + 1 is called a linear function because its graph is a line. It is not a linear 
transformation from the vector space R into R, however, because it preserves neither vector 
addition nor scalar multiplication. 


Two simple linear transformations are the zero transformation and the identity 
transformation, which are defined as follows. 


1. T(v) = 0, for all v Zero transformation (T: V—> W) 
2. T(v) = v, for all v Identity transformation (7: VV) 


The verifications of the linearity of these two transformations are left as exercises. (See 
Exercises 68 and 69.) 

Note that the linear transformation in Example 2 has the property that the zero vector is 
mapped to itself. That is, 7(0) = 0. (Try checking this.) This property is true for all linear 
transformations, as stated in the next theorem. 


Let T be a linear transformation from V into W, where u and v are in V. Then the 
following properties are true. 


1. 710) = 0 

2. T(—v) = —T(v) 

3. Tu — v) = T(u) — T(v) 

Bk WAY Shy aP Ghia ar 2 2 Oar GAG. 
then 


T(v) = T(c,v, + cv, ++: - + +,y,) 


non 


CLV ot CaltVa is ot CTY) 


PROOF 


EXAMPLE 4 
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To prove the first property, note that Ov = 0. Then it follows that 
T(0) = T(Ov) = O7(v) = 0. 


The second property follows from —v = (—1)v, which implies that 
Hey = 7(=y)] == Diy) = 7). 


The third property follows from u — v = u + (—v), which implies that 
T(u — v) = T[u + (—1)v] = Tw) + (—1)T(v) = T(u) — T(y). 


The proof of the fourth property is left to you. 


Property 4 of Theorem 6.1 tells you that a linear transformation T: V— W is determined 
completely by its action on a basis of V. In other words, if {v,, V>,. . ., V,,} is a basis for 
the vector space V and if T(v,), T(v3),. . ., T(v,,) are given, then 7(v) is determined for 
any Vv in V. The use of this property is demonstrated in Example 4. 


Linear Transformations and Bases 


SOLUTION 


Let T: R? > R? be a linear transformation such that 
T(1, 0, 0) = (2, —1, 4) 
T(0, 1,0) = (1, 5, —2) 
T(0, 0, 1) = (0, 3, 1). 
Find 7(2, 3, —2). 
Because (2, 3, — 2) can be written as 
(2, 3, —2) = 2(1, 0, 0) + 3(0, 1, 0) — 2(0, 0, 1), 
you can use Property 4 of Theorem 6.1 to write 
T(2, 3, —2) = 27(1, 0,0) + 37(0, 1,0) — 27(0, 0, 1) 
= 2(2, -1,4) + 3(1, 5, -2) — 2(0, 3, 1) 
= (7,7, 0). 


Another advantage of Theorem 6.1 is that it provides a quick way to spot functions that 
are not linear transformations. That is, because all four conditions of the theorem must be 
true of a linear transformation, it follows that if any one of the properties is not satisfied for 
a function 7, then the function is not a linear transformation. For example, the function 


Tx 43) = Gy eas) 


is not a linear transformation from R? to R2 because 7(0, 0) # (0, 0). 


366 


Chapter 6 Linear Transformations 


In the next example, a matrix is used to define a linear transformation from R? into R>. 
The vector v = (v,, v5) is written in the matrix form 


v 
: 7 i 
Vo 


so it can be multiplied on the left by a matrix of order 3 x 2. 


EXAMPLE 5|_ A Linear Transformation Defined by a Matrix 


The function T: R? — R? is defined as follows. 


a. oO 
Vv 
T(x) =Av=| 2 ||| 
aq =|" 


(a) Find 7(v), where v = (2, —1). 
(b) Show that T is a linear transformation from R? into R°. 


SOLUTION (a) Because v = (2, — 1), you have 


3 0 6 

2 
T(v) =Av=] 2 1 |_i|- 3 
=), =2 0 


So, you have 7(2, — 1) = (6, 3, 0). 


(b) Begin by observing that T does map a vector in R? to a vector in R*. To show that T is 
a linear transformation, use the properties of matrix multiplication, as shown in 
Theorem 2.3. For any vectors u and v in R?, the distributive property of matrix 
multiplication over addition produces 


T(u + v) = A(u + vy) = Au + Av = 7(u) + T(v). 


Similarly, for any vector u in R? and any scalar c, the commutative property of scalar 
multiplication with matrix multiplication produces 


T(cu) = A(cu) = c(Au) = c7(u). 


Example 5 illustrates an important result regarding the representation of linear transfor- 
mations from R” into R”. This result is presented in two stages. Theorem 6.2 on the next 
page states that every m x n matrix represents a linear transformation from R” into R”. 
Then, in Section 6.3, you will see the converse—that every linear transformation from R” 
into R” can be represented by an m x n matrix. 


THEOREM 6.2 


The Linear Transformation 


Given by a Matrix 


EXAMPLE 6 
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Note in part (b) of Example 5 that no reference is made to the specific matrix A. This 
verification serves as a general proof that the function defined by any m x n matrix is a 
linear transformation from R” into R”. 


Let A be an m x n matrix. The function T defined by 
T(v) = Av 


is a linear transformation from R” into R”. In order to conform to matrix multiplication 
with an m x n matrix, the vectors in R” are represented by n x | matrices and the vectors 
in R” are represented by m x | matrices. 


REMARK: The m xn zero matrix corresponds to the zero transformation from R” 
into R”, and the n x n identity matrix J, corresponds to the identity transformation from R” 
into R”. 


Be sure you see that an m x n matrix A defines a linear transformation from R” into R”. 


Gy, Ayn 7 7 Ain} | Vy AyVy + AyyVy He + Ay Vy, 

— | 4a Ann Any |] Vo] _ | Gai¥y + Gy¥. Fs + Gy, V, 
Av =| : oi = ; ; 

Qin\ Qn2 ans Ginn Va QmiY + Qn2Y2 ate ote QinnYn 


Linear Transformation Given by Matrices 


The linear transformation T: R" > R” is defined by T(v) = Av. Find the dimensions of R” 
and R” for the linear transformation represented by each matrix. 


0 1-1 
(ay A=|2 3 O 
A 2 4 
9 =4 
(b) A=|-5 0 
0 =2 


1 0 -1 2 
@a=| 
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SOLUTION 


into R3. 


(a) Because the size of this matrix is 3 x 3, it defines a linear transformation from R? 
0 1 -l1]\y, Uy 
=|2 3 0] |v 
4 


Uy 


2 1} Lv; Uy 
Vector Vector 
in R3 in R3 


into R?. 


(b) Because the size of this matrix is 3 x 2, it defines a linear transformation from R? 
into R?. 


(c) Because the size of this matrix is 2 x 4, it defines a linear transformation from R* 
EXAMPLE 7 


In the next example, a common type of linear transformation from R? into R? is discussed. 
Rotation in the Plane 


—sin a1 
sin 0 cos 8 


Show that the linear transformation T: R* > R? represented by the matrix 
cos 6 
A= 
has the property that it rotates every vector in R* counterclockwise about the origin through 


the angle 6. 
SOLUTION 


From Theorem 6.2, you know that T is a linear transformation. To show that it rotates every 
polar coordinates, you can write v as 


vector in R? counterclockwise through the angle 6, let v = (x, y) be a vector in R*. Using 
v = (x, y) = (rcos a, rsin a), 


_ |cos@ —sin 6} | x 
7 sin 0 cos | | 

cos @ -—sin@||rcosa 
sin 0 cos rsin | 

rcos @cos@ — rsin @sina 

1a y i @cos a + rcos @sin i 
Rotation in the Plane : rcos(@ + a) 
Figure 6.2 ~ 


r sin(@ + | 


where r is the length of v and a is the angle from the positive x-axis counterclockwise to 
the vector v. Now, applying the linear transformation T to v produces 
T(v) = Av 


x 


T(x, y, z) = (x, y, 0) 


EXAMPLE 8 
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So, the vector 7(v) has the same length as v. Furthermore, because the angle from the 
positive x-axis to T(v) is 6 + a, T(v) is the vector that results from rotating the vector v 
counterclockwise through the angle 6, as shown in Figure 6.2 on the previous page. 


REMARK: The linear transformation in Example 7 is called a rotation in R?. Rotations 
in R? preserve both vector length and the angle between two vectors. That is, the angle 
between u and v is equal to the angle between 7(u) and 7(v). 


A Projection in R? 


z 


(x, y, Z) 


----<«---#® 


y 


Projection onto xy-plane 


Figure 6.3 


EXAMPLE 9 


The linear transformation T: R* — R? represented by 


1 0 0 
A=/0 1 0 
0 0 0 


is called a projection in R°. If v = (x, y, z) is a vector into R*, then T(v) = (x, y, 0). In 
other words, T maps every vector in R? to its orthogonal projection in the xy-plane, as 
shown in Figure 6.3. 


So far only linear transformations from R” into R” or from R” into R” have been 
discussed. In the remainder of this section, some linear transformations involving vector 
spaces other than R” will be considered. 


A Linear Transformation from M,, ,, into M,, 


SOLUTION 


Let T: M,,,,>M,,,,, be the function that maps an m x n matrix A to its transpose. That is, 
T(A) = AT. 
Show that 7 is a linear transformation. 
Let A and B be m x n matrices. From Theorem 2.6 you have 
T(A + B) = (A+B)? 
= AT + BT 
= T(A) + T(B) 
and 


T(cA) 


(cA)" 
c(A‘) 
cT(A). 


So, T is a linear transformation from Minto M 


mn nm 
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EXAMPLE 10 


The Differential Operator (Calculus) 


SOLUTION 


EXAMPLE 11 


Let C’[a, b] be the set of all functions whose derivatives are continuous on [a, b]. Show 
that the differential operator D, defines a linear transformation from C’[a, b] into C[a, b]. 


Using operator notation, you can write 


Df) = SU 


where f is in C’[a, b]. To show that D, is a linear transformation, you must use calculus. 
Specifically, because the derivative of the sum of two functions is equal to the sum of their 
derivatives and because the sum of two continuous functions is continuous, you have 


DAf+ 9) = <1f+ l= SU + SIs] 


= DAf) + Dig): 


Similarly, because the derivative of a scalar multiple of a function is equal to the scalar 
multiple of the derivative and because the scalar multiple of a continuous function is 
continuous, you have 


Def) = Stef = (210) 
= D,{f). 


So, D, is a linear transformation from C’[a, b] into C[a, b]. 


The linear transformation D, in Example 10 is called the differential operator. For 
polynomials, the differential operator is a linear transformation from P,, into P,,_ , because 
the derivative of a polynomial function of degree n is a polynomial function of degree 
n — 1 or less. That is, 


Dfa,x" +++ ++ a,x +a.) =na,x""!+-+++ a. 


The next example describes a linear transformation from the vector space of polynomial 
functions P into the vector space of real numbers R. 


The Definite Integral as a Linear Transformation (Calculus) 


Let T: PR be defined by 


T(p) = i p(x) dx. 


Show that 7 is a linear transformation from P, the vector space of polynomial functions, 
into R, the vector space of real numbers. 
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SOLUTION Using properties of definite integrals, you can write 


1p + 4) = | Porro: 


and 


[ p00 dx + i q(x) dx 


T(p) + T(q) 


b 


T(cp) = i c[p()] dx = ¢ | p(x) dx = cT(p). 


So, T is a linear transformation. 


SECTION 6.1 Exercises 


In Exercises 1-8, use the function to find (a) the image of v and 11. T: R? > R’, T(x, y, z) = (x + y, x — y, z) 
(b) the preimage of w. 


1. 
2. 
3. 


12. T: ROR, T(x, y,d =@+ lyt+1,z24+ 1) 


Ty, Vy) = (v, Vo, Vy V>), hes: (3, 4), w= (3, 19) 13. T: R? > R?, T(x, y) = (ea xy, Vy) 
Ty, Vo) = (2. — Vy, V4, V2), V = (0, 6), w = (3, 1, 2) 


T(V,, Vo, V3) = (v2 — Vy, V1 + V2, 2v,), V = (2, 3, 0), 


w = (-11, —1, 10) 


14. T: R? > R?, T(x, y) = (x2, xy, y?) 
15. T: M,,R, T(A) = |A| 


b 
16. T:M,,—R, TA) = a+b +c + d, where A = I“ | 


4. T(v,, Vo, ¥3) = (2, + v2, 2v9 — 34, v1 — V3), d 
v = (-4,5, 1), w= (4,1, -D 0 0 l 
5. T(v,, Vy, V3) = (4, — v1, 4, + Sv2), v = (2, —3, -1), Be FM goss T(A) = ; ; io 
w = (3, 9) 
6. T(v4, Vo» v3) = (2v, + Vy ¥, — ¥»), ¥ = (2, 1,4), ro 
7 18. T-M,,>M,,7(A)=|0 1 O|A 
w = (1,2) 3.3 3.3 
Ss ds 0 oO -1 
2 2 
7. Tv, V2) = ( yy hee + V5, 2v, ve 19, T: M,,—M,,, T(A) = AT 
20. T:M,,—M,,, T(A) = An! 
v = (1, 1), w = (—5/2, —2, —16) ieee 
21. T: P,P, Tag + ayx + a,x?) = 
v3 ! 1 1 1 i vs 
8. T(v,, v2) = ML 5 ¥a M1 — Var V2 Jp (dy + a, + a5) + (a, + ay)x + ax 
22. T: P> > P>, T(ay + ax + ax?) = a, + 2a,x 
v= (2,4), w = (V3,2,0) 27 Fo, Lg 1 2 r 2 
; ; ae ; In Exercises 23-26, let T: R? — R? be a linear transformation 
Tn Exercises 9-22, determine whether the function is a linear such that 7(1,0,0) = (2,4,—-1), 7(0,1,0) = (1,3,—2), and 
transformation. 7(0, 0, 1) = (0, —2, 2). Find 
9. T: PR, Tx, y) = &, 1D) 23, 10, 3,=1). 24, T(2, —1, 0). 


10. 


T: R2 > R2, T(x, y) = (22, y) 


25. 7(2,—4, 1). 26. T(—2, 4, -1). 
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In Exercises 27-30, let T: R? > R? be a linear transformation 
such that 7(1, 1, 1) = (2,0,—1), 7(0, -1, 2) = (—3,2,—1), and 
7(1, 0, 1) = (1, 1, 0). Find 


27. TE, 1,0). 
29. T(2,—1, 1). 


28. T(0, 2, —1). 
30. T(—2, 1, 0). 


In Exercises 31—35, the linear transformation T: R” > R” is defined 
by 7T(v) = Av. Find the dimensions of R” and R”. 


0 I, = 2 1 
31.4 =]-1 oF 5 0 
0 1 3 1 
1 2 
32. A =| —-2 + 
=2 2 
=| 2 1 3 4 
A= 
a | 0 0 2 =1 | 
= 0 0 0 
34. A = : : : 
0 0 2 0 
0 0 0 1 
0 -=1 
5. A = 
sa-[ 


36. For the linear transformation from Exercise 31, find 
(a) T(1, 0, 2, 3) and (b) the preimage of (0, 0, 0). 

37. Writing For the linear transformation from Exercise 32, 
find (a) 7(2, 4) and (b) the preimage of (—1, 2, 2). (c) Then 
explain why the vector (1, 1,1) has no preimage under this 
transformation. 


38. For the linear transformation from Exercise 33, find 
(a) T(1, 0, — 1, 3, 0) and (b) the preimage of (— 1, 8). 

39. For the linear transformation from Exercise 34, find 
(a) T(1, 1, 1, 1) and (b) the preimage of (1, 1, 1, 1). 

40. For the linear transformation from Exercise 35, find 
(a) T(1, 1), (b) the preimage of (1, 1), and (c) the preimage of 
(0, 0). 

41. Let T be the linear transformation from R? into R? represented 
by T(x, y) = (x cos 6 — y sin 0, x sin 8 + y cos 8). 
Find (a) 7(4,4) for 6 = 45°, (b) 7(4,4) for @ = 30°, and 
(c) T(5, 0) for 9 = 120°. 

42. For the linear transformation from Exercise 41, let @ = 45° and 
find the preimage of v = (1, 1). 


In Exercises 43-46, let D, be the linear transformation from 
C’[a, b] into C[a,b] from Example 10. Decide whether each 
statement is true or false. Explain your reasoning. 

43. D(e*’ + 2x) = D(e*’) + 2D,(x) 

44, D(x? — Inx) = D(x?) — D,(In x) 

45. D,(sin 2x) = 2D,(sin x) 


46. D,{ *) = 7D. ) 
. D,\ cos >] = 5D,(cos x 


Calculus In Exercises 47—50, for the linear transformation from 
Example 10, find the preimage of each function. 


47, f(x) = 2x +1 48. f(x) = e* 


49. f(x) = sin x 50. f(x) = . 


51. Calculus Let T be the linear transformation from P into R 
shown by 


1 
f(p) = [ p(x) dx. 

0 
Find (a) 7(3x? — 2), (b) T(x? — x°), and (c) T(4x — 6). 


52. Calculus Let T be the linear transformation from P, into R 
represented by the integral in Exercise 51. Find the preimage of 
1. That is, find the polynomial function(s) of degree 2 or less 
such that 7(p) = 1. 


53. Let T be a linear transformation from R? into R? such that 
T(1, 1) = (1,0) and (1, —1) = (O, 1). Find 7(1,0) and 7(0, 2). 

54. Let T be a linear transformation from R? into R? such that 
T(1,0) = (1, 1) and 710, 1) = (-1, 1). Find 7(1, 4) and T(-2, 1). 


55. Let T be a linear transformation from P, into P, such 
that 7(1) = x, T(x) = 1+ x, and T(x?) = 1+ x + x. Find 
T(2 — 6x + x7). 


56. Let T be a linear transformation from M, , into M,, such that 
( 0) k a (F ) i 
T = , T = , 
0 0 0 2 0 O 1 1 
lr ol-[o ak vs i=l “oh 
1 0 0 1 0 1 1 0 


True or False? In Exercises 57 and 58, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


57. 


58. 


59. 


60. 


61. 


62. 


63. 


(a) Linear transformations are functions from one vector space 
to another that preserve the operations of vector addition and 
scalar multiplication. 


(b) The function f(x) = cos x is a linear transformation from R 
into R. 


(c) For polynomials, the differential operator D, is a linear 
transformation from P, into P,,_,. 


(a) A linear transformation is operation preserving if the 
same result occurs whether the operations of addition and 
scalar multiplication are performed before or after the linear 
transformation is applied. 


(b) The function g(x) = x? is a linear transformation from 
R into R. 


(c) Any linear function of the form f(x) = ax + b is a linear 
transformation from R into R. 


Writing Suppose T: R?—> R? such that 7(1, 0) = (1, 0) and 
T(0, 1) = (0, 0). 

(a) Determine T(x, y) for (x, y) in R?. 

(b) Give a geometric description of T. 

Writing Suppose T: R?->R? such that 7(1, 0) = (0, 1) and 
4(0,,1) = (1,0). 

(a) Determine 7(x, y) for (x, y) in R?. 

(b) Give a geometric description of T. 

Let T be the function from R? into R* such that T(u) = proj,u, 
where v = (1, 1). 

(a) Find 7(x, y). (b) Find 7(5, 0). 

(c) Prove that T(u + w) = T(u) + 7(w) for every u and w 
in R?. 

(d) Prove that T(cu) = cT(u) for every u in R?. This result 
and the result in part (c) prove that T is a linear 
transformation from R? into R?. 

Writing Find 7(3, 4) and 7(7(3, 4)) from Exercise 61 and give 
geometric descriptions of the results. 


Show that T from Exercise 61 is represented by the matrix 


Nie NI 
Nie NI 
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64. 


65. 


66. 


67. 


68. 


69. 


70. 


71. 


72. 
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Use the concept of a fixed point of a linear transformation 
T: VV. A vector u is a fixed point if 7(u) = u. 


(a) Prove that 0 is a fixed point of any linear transformation 
T: VV. 


(b) Prove that the set of fixed points of a linear 
transformation T: V— V is a subspace of V. 


(c) Determine all fixed points of the linear transformation 
T: R* > R? represented by T(x, y) = (x, 2y). 
(d) Determine all fixed points of the linear transformation 
T: R? > R? represented by T(x, y) = (y, x). 
A translation is a function of the form T(x, y) = 


(x — h, y — k), where at least one of the constants h and k is 
nonzero. 


(a) Show that a translation in the plane is not a linear 
transformation. 

(b) For the translation T(x, y) = (x — 2, y + 1), determine 
the images of (0, 0), (2, — 1), and (5, 4). 


(c) Show that a translation in the plane has no fixed points. 


Let S = {v,,V>,...,V,+ be a set of linearly dependent 
vectors in V, and let 7 be a linear transformation from V into V. 
Prove that the set 


{T(v,), T(v>), toes T(v,,) } 
is linearly dependent. 


Let S = {v,, V,, V3} be a set of linearly independent vectors in 
R°, Find a linear transformation T from R? into R? such that the 
set {T(v,), T(v>), T(v3)} is linearly dependent. 


Prove that the zero transformation T: VW is a linear 
transformation. 


Prove that the identity transformation T: VV is a linear 
transformation. 


Let V be an inner product space. For a fixed vector vy in V, 
define T:; VR by T(v) = (v, vo). Prove that T is a linear 
transformation. 


Let T: M,,,, > R be defined by T(A) = a,, + dy. +++ + +4 


nn 


(the trace of A). Prove that 7 is a linear transformation. 


mn 


Let V be an inner product space with a subspace W having 
B = {w,, Wo,. . ., W,,} as. an orthonormal basis. Show that the 
function T: V— W represented by 

Tv) = (v, Wi)W, + (Vv, W2)Wo + °° 


is a linear transformation. T is called the orthogonal projection 
of V onto W. 


‘ + (v, W,,)W,, 
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73. Guided Proof Let {v,, v5,. . ., Vv, be a basis for a vector 
space V. Prove that if a linear transformation T: V>V 
satisfies T(v,) = 0 for i= 1,2,...,n, then T is the zero 
transformation. 


Getting Started: To prove that T is the zero transformation, 
you need to show that 7(v) = 0 for every vector v in V. 


(i) Let v be an arbitrary vector in V such that 


V=H CV, + CoV. T° + CV 


n'n 


(ii) Use the definition and properties of linear transforma- 
tions to rewrite T(v) as a linear combination of T(v,). 


(iii) Use the fact that T(v,) = 0 to conclude that T(v) = 0, 
making T the zero transformation. 


74. Guided Proof Prove that T: V— Wis a linear transformation 
if and only if T(au + bv) = aT(u) + bT(v) for all vectors u 
and v and all scalars a and b. 


Getting Started: Because this is an “if and only if” statement, 
you need to prove the statement in both directions. To prove that 
T is a linear transformation, you need to show that the function 
satisfies the definition of a linear transformation. In the other 
direction, suppose T is a linear transformation. You can use the 
definition and properties of a linear transformation to prove that 
T(au + bv) = aT(u) + bT(v). 


(i) Suppose T(au + by) = aT(u) + bT(v). Show that T 
preserves the properties of vector addition and scalar 
multiplication by choosing appropriate values of a 
and b. 


(ii) To prove the statement in the other direction, assume 
that T is a linear transformation. Use the properties and 
definition of a linear transformation to show that 
T(au + by) = aT(u) + bT(vy). 


6.2 | The Kernel and Range of a Linear Transformation 


You know from Theorem 6.1 that for any linear transformation T: V— W, the zero vector 
in V is mapped to the zero vector in W. That is, 


7(0) = 0. 


The first question you will consider in this section is whether there are other vectors v such 
that 7(v) = 0. The collection of all such elements is called the kernel of 7. Note that the 
symbol 0 is used to represent the zero vector in both V and W, although these two zero 


vectors are often different. 


Definition of Kernel of a Let T: VW be a linear transformation. Then the set of all vectors v in V that satisfy 


Linear Transformation 


T(v) = 0 is called the kernel of T and is denoted by ker(7). 


Sometimes the kernel of a transformation is obvious and can be found by inspection, as 
demonstrated in Examples 1, 2, and 3. 


EXAMPLE 1| _ Finding the Kernel of a Linear Transformation 


Let T: M;,— M, , be the linear transformation that maps a 3 x 2 matrix A to its transpose. 


That is, 
T(A) = A’. 
Find the kernel of T. 


SOLUTION 


EXAMPLE 2 
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For this linear transformation, the 3 x 2 zero matrix is clearly the only matrix in M, , whose 
transpose is the zero matrix in M, 3. 


Zero Matrix in M; 5 Zero Matrix in M, 
0 0 

0 0 0 

0=/0 0 0= “a o. ~~ 
0 0 


So, the kernel of T consists of a single element: the zero matrix in M; ,. 


The Kernels of the Zero and Identity Transformations 


EXAMPLE 3 


(a) The kernel of the zero transformation T: V— W consists of all of V because 7(v) = 0 
for every v in V. That is, ker(7) = V. 


(b) The kernel of the identity transformation T: V— V consists of the single element 0. 
That is, ker(T) = {O}. 


Finding the Kernel of a Linear Transformation 


SOLUTION 


Find the kernel of the projection T: R? — R? represented by 
T(x, y, 2) = (x, y, 0). 


This linear transformation projects the vector (x, y, z) in R® to the vector (x, y, 0) in the 
xy-plane. The kernel consists of all vectors lying on the z-axis. That is, 


ker(T) = {(0, 0, z): z is a real number}. (See Figure 6.4.) 


(x, y, 0) 


The kernel of T is the set 
of all vectors on the z-axis. 


Figure 6.4 
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Finding the kernels of the linear transformations in Examples 1, 2, and 3 was fairly easy. 
Generally, the kernel of a linear transformation is not so obvious, and finding it requires a 
little work, as illustrated in the next two examples. 


EXAMPLE 4| _ Finding the Kernel of a Linear Transformation 


Find the kernel of the linear transformation T: R* > R? represented by 
T(x, X>) = (x; — 2x5, 0, —x)). 
SOLUTION — To find ker(T), you need to find all x = (x,, x5) in R? such that 
T(x,, X>) = (x, — 2x, 0, —x)) = (0, 0, 0). 
This leads to the homogeneous system 


x, — 2x, = 0 


= = 6, 
which has only the trivial solution (x,, x5) = (0, 0). So, you have 


ker(T) = {(0, 0)} = {0}. 


EXAMPLE 5|_ Finding the Kernel of a Linear Transformation 


Find the kernel of the linear transformation T: R* + R? defined by T(x) = Ax, where 


i =i =3 
a=| I 2 a} 


SOLUTION The kernel of T is the set of all x = (x,, x5, x3) in R? such that 
T(x, Xo5 X3) = (0, 0). 
From this equation you can write the homogeneous system 
x, = 
i; <4 3 °) X,— X% — 2x, =0 
x,| = = 
=i <2. B)i"* 0 —x, + 2x, + 3x, =0. 
X3 : 
Writing the augmented matrix of this system in reduced row-echelon form produces 


k 0 -Il 0 
0 1 1 0 


Using the parameter ¢ = x, produces the family of solutions 


xy t 1 
x,|=|-t)=aq-1). 
X3 t 1 


Kernel: 
(1, -1, 1) 
Figure 6.5 
THEOREM 6.3 
The Kernel Is a 
Subspace of V 


PROOF 


REMARK: As aresult of 
Theorem 6.3, the kernel of T is 
sometimes called the nullspace 
of T. 


EXAMPLE 6 
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So, the kernel of T is represented by 
ker(T) = {t(1, —1, 1): tis a real number} 
= span{(1, —1, 1)}. 


Note that in Example 5 the kernel of T contains an infinite number of vectors. Of course, 
the zero vector is in ker(7), but the kernel also contains such nonzero vectors as (1, — 1, 1) 
and (2, —2, 2), as shown in Figure 6.5. Figure 6.5 shows that this particular kernel is a line 
passing through the origin, which implies that it is a subspace of R?. In Theorem 6.3 you 
will now see that the kernel of every linear transformation T: V— W is a subspace of V. 


The kernel of a linear transformation T: V— W is a subspace of the domain V. 


From Theorem 6.1 you know that ker(7) is a nonempty subset of V. So, by Theorem 4.5, you 
can show that ker(7) is a subspace of V by showing that it is closed under vector addition 
and scalar multiplication. To do so, let u and v be vectors in the kernel of 7. Then 


T(u + v) = T(u) + Tv) 


=0+0 
= 0, 
which implies that u + v is in the kernel. Moreover, if c is any scalar, then 
T(cu) = cT(u) 
= c0 
= 0, 


which implies that cu is in the kernel. 


The next example shows how to find a basis for the kernel of a transformation defined 
by a matrix. 


Finding a Basis for the Kernel 


Let T: R° > R* be defined by T(x) = Ax, where x is in R° and 


1 2 0 LL =I 
2 1 3 1 0 
= 4 0 =-2 0 1; 
0 0 0 2 8 


A= 


Find a basis for ker(T) as a subspace of R°. 
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SOLUTION Using the procedure shown in Example 5, reduce the augmented matrix [A : 0] to echelon 
form as follows. 


1 0 2 0 -i1 0 
( 4 =i mo @ Pie ee 
> © & 1-2 o Pe Ss 
x4 = — 4x, 
0 0 0 0 0 0 
Discovery Letting x, = s and x; = f, you have 

What is the rank of the matrix A xy —2s+ ¢ —2 1 

in Example 6? Formulate a X, s+ 2t 1 Z 

conjecture relating the dimension X=] x3] = s+ Or | =s| 1l]4+t} O}. 

of the kernel, the rank, and the x4 Os — 4t 0 —4 

number of columns of A. Verify Xs Os + t 0 1 


your conjecture for the matrix in 
Example 5. 


So one basis for the kernel of T is 


B = {(—2, 1, 1, 0, 0), (, 2, 0, —4, 1}. 


In the solution of Example 6, a basis for the kernel of T was found by solving the 
homogeneous system represented by Ax = 0. This procedure is a familiar one—it is the 
same procedure used to find the solution space of Ax = 0. In other words, the kernel of T 
is the nullspace of the matrix A, as shown in the following corollary to Theorem 6.3. 


COROLLARY TO — Let T: R'’—>R” be the linear transformation given by 7(x) = Ax. Then the kernel of T is 
THEOREM 6.3 equal to the solution space of Ax = 0. 


The Range of a Linear Transformation 


The kernel is one of two critical subspaces associated with a linear transformation. The 
second is the range of 7, denoted by range(7). Recall from Section 6.1 that the range 
of T: VW is the set of all vectors w in W that are images of vectors in V. That is, 
range(T) = {7(v): vis in V}. 


THEOREM 6.4 
The Range of T 
Is a Subspace of W 


PROOF The range of T is nonempty because 7(0) = 0 implies that the range contains the zero 
vector. To show that it is closed under vector addition, let T(u) and 7(v) be vectors in the 
range of T. Because u and v are in V, it follows that u + v is also in V. So, the sum 
T(u) + T(v) = T(u + y) is in the range of T. 


Domain Kernel 


Range 
. SD» 
Figure 6.6 


COROLLARY TO 
THEOREM 6.4 


EXAMPLE 7 
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To show closure under scalar multiplication, let T(u) be a vector in the range of T and 
let c be a scalar. Because u is in V, it follows that cu is also in V. So, the scalar multiple 
cT(u) = T(cu) is in the range of T. 


Note that the kernel and range of a linear transformation T: V— W are subspaces of 
V and W, respectively, as illustrated in Figure 6.6. 

To find a basis for the range of a linear transformation defined by 7(x) = Ax, observe 
that the range consists of all vectors b such that the system Ax = b is consistent. By writ- 
ing the system 


Ay; Qjg --+- Ay x; b, 

Ay, Ann +--+ Any Xy b, 

Ant Anz + * + Ann Xn Diy 

in the form 
ayy a12 An b, 
a9) 442 Ay b, 
Ax = x; +X) ce | x. = =b 

ant An2 Ann Din 


you can see that b is in the range of T if and only if b is a linear combination of the column 
vectors of A. So the column space of the matrix A is the same as the range of T. 


Let T: R’— R” be the linear transformation given by 7(x) = Ax. Then the column space 
of A is equal to the range of T. 


In Example 4 in Section 4.6, you saw two procedures for finding a basis for the column 
space of a matrix. In the next example, the second procedure from Example 4 in Section 
4.6 will be used to find a basis for the range of a linear transformation defined by a matrix. 


Finding a Basis for the Range of a Linear Transformation 


SOLUTION 


For the linear transformation R° — R* from Example 6, find a basis for the range of T. 


The echelon form of A was calculated in Example 6. 


1 2 0 1-1 i o. o @ =i 
a i 4 i <1 =O 
ne ee ee ~lo 0 0 1 4 
0 0 0 2 8 0 0 0 0 0 
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Definition of Rank 
and Nullity of a 
Linear Transformation 


THEOREM 6.5 
Sum of Rank 
and Nullity 


PROOF 


Because the leading 1’s appear in columns 1, 2, and 4 of the reduced matrix on the right, 
the corresponding column vectors of A form a basis for the column space of A. One basis 
for the range of T is 


B = {(1, 2, —1, 0), (2, 1, 0, 0), (1, 1, 0, 2)}. 


The following definition gives the dimensions of the kernel and range of a linear 
transformation. 


Let T: V— W be a linear transformation. The dimension of the kernel of T is called the 
nullity of T and is denoted by nullity(7). The dimension of the range of T is called the 
rank of T and is denoted by rank(7). 


REMARK: If Tis provided by a matrix A, then the rank of T is equal to the rank of A, as 
defined in Section 4.6. 


In Examples 6 and 7, the nullity and rank of T are related to the dimension of the domain 
as follows. 
rank(T) + nullity(7) = 3 + 2 = 5 = dimension of domain 


This relationship is true for any linear transformation from a finite-dimensional vector 
space, as stated in the next theorem. 


Let T: VW be a linear transformation from an n-dimensional vector space V into a 
vector space W. Then the sum of the dimensions of the range and kernel is equal to the 
dimension of the domain. That is, 


rank(7) + nullity(7) =n 
or 


dim(range) + dim(kernel) = dim(domain). 


The proof provided here covers the case in which Tis represented by an m x n matrix A. The 
general case will follow in the next section, where you will see that any linear transforma- 
tion from an n-dimensional space to an m-dimensional space can be represented by a matrix. 
To prove this theorem, assume that the matrix A has a rank of r. Then you have 


rank(T) = dim(range of T) = dim(column space) = rank(A) = r. 
From Theorem 4.17, however, you know that 


nullity(7) = dim(kernel of T) = dim(solution space) = n — r. 
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So, it follows that 


rank(7) + nullity(7) = r+ (n—-—r) =n. 


EXAMPLE 8| _ Finding the Rank and Nullity of a Linear Transformation 


Find the rank and nullity of the linear transformation T: R*? > R? defined by the matrix 


1 Q =2 
A=|0 1 1}. 
0 0 0 


SOLUTION Because A is in row-echelon form and has two nonzero rows, it has a rank of 2. So, the rank 
of T is 2, and the nullity is dim(domain) — rank = 3 — 2 = 1. 


REMARK: One way to visualize the relationship between the rank and the nullity of a 
linear transformation provided by a matrix is to observe that the rank is determined by the 
number of leading 1’s, and the nullity by the number of free variables (columns without 
leading 1’s). Their sum must be the total number of columns of the matrix, which is the 
dimension of the domain. In Example 8, the first two columns have leading 1’s, indicating 
that the rank is 2. The third column corresponds to a free variable, indicating that the 
nullity is 1. 


EXAMPLE 9| _ Finding the Rank and Nullity of a Linear Transformation 


Let T: R°—> R’ be a linear transformation. 


(a) Find the dimension of the kernel of T if the dimension of the range is 2. 
(b) Find the rank of T if the nullity of T is 4. 
(c) Find the rank of T if ker(T) = {0}. 


SOLUTION (a) By Theorem 6.5, with n = 5, you have 
dim(kernel) = n — dim(range) = 5 — 2 = 3. 
(b) Again by Theorem 6.5, you have 
rank(T) = n — nullity(7T) =5 —4= 1. 
(c) In this case, the nullity of T is 0. So 
rank(T) = n — nullity(T) = 5 —0=5. 
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THEOREM 6.6 
One-to-One Linear 
Transformations 


PROOF 


EXAMPLE 10 


One-to-One and Onto Linear Transformations 


This section began with a question: How many vectors in the domain of a linear transfor- 
mation are mapped to the zero vector? Theorem 6.6 (below) shows that if the zero vector 
is the only vector v such that 7(v) = 0, then Tis one-to-one. A function T: V— W is called 
one-to-one if the preimage of every w in the range consists of a single vector, as shown 
in Figure 6.7. This is equivalent to saying that T is one-to-one if and only if, for all u and 
v in V, T(u) = T(v) implies u = v. 


One-to-one Not one-to-one 


Figure 6.7 


Let T: V— W be a linear transformation. Then T is one-to-one if and only if ker(7) = {0}. 


Suppose T is one-to-one. Then 7(v) = 0 can have only one solution: v = 0. In that case, 
ker(T) = {0}. Conversely, suppose ker(T) = {0} and T(u) = T(v). Because T is a linear 
transformation, it follows that 


T(u — v) = 7T(u) — T(v) = 0. 


This implies that the vector u — v lies in the kernel of T and must equal 0. So, u — v = 0 
and u = vy, and you can conclude that T is one-to-one. 


One-to-One and Not One-to-One Linear Transformations 


(a) The linear transformation T: M,,,,M,,,, represented by 7(A) = A” is one-to-one 


because its kernel consists of only the m x n zero matrix. 


(b) The zero transformation T: R? > R? is not one-to-one because its kernel is all of R*. 


THEOREM 6.7 


Onto Linear 
Transformations 


THEOREM 6.8 
One-to-One and Onto 
Linear Transformations 


PROOF 


EXAMPLE 11 
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A function T: V— W is said to be onto if every element in W has a preimage in V. In 
other words, T is onto W when W is equal to the range of 7. 


Let T: VW be a linear transformation, where W is finite dimensional. Then T is onto if 
and only if the rank of T is equal to the dimension of W. 


For vector spaces of equal dimensions, you can combine the results of Theorems 6.5, 
6.6, and 6.7 to obtain the next theorem relating the concepts of one-to-one and onto. 


Let T: V— W be a linear transformation with vector spaces V and W both of dimension n. 
Then T is one-to-one if and only if it is onto. 


If T is one-to-one, then by Theorem 6.6 ker(7) = {0}, and dim(ker(7)) = 0. In that case, 
Theorem 6.5 produces 


dim(range of T) = n — dim(ker(T7)) 
=n 
= dim(W). 
Consequently, by Theorem 6.7, T is onto. Similarly, if T is onto, then 
dim(range of T) = dim(W) = n, 
which by Theorem 6.5 implies that dim(ker(7)) = 0. By Theorem 6.6, T is one-to-one. 


The next example brings together several concepts related to the kernel and range of a 
linear transformation. 


Summarizing Several Results 


The linear transformation T: R’—> R” is represented by 7(x) = Ax. Find the nullity and 
rank of T and determine whether J is one-to-one, onto, or neither. 


i & © i; 2 
(ay A=|0 1 1 (b)A=|0 1 
0 Oo 1 0 O 
i 3 
@a=|, ‘ 4 (d)A=|0 1 : 
0 1-1 
0 oO 0 
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SOLUTION 


Definition of 
Isomorphism 


THEOREM 6.9 
Isomorphic Spaces 
and Dimension 


PROOF 


Note that each matrix is already in echelon form, so that its rank can be determined by 
inspection. 


Dim(range) Dim(kernel) 


T: R" > R" Dim(domain) Rank(T) Nullity(7) One-to-One Onto 
(a) T: ROR? 3 3 0 Yes Yes 
(b) T: R?> R? 2 2 0 Yes No 
(c) T: R?— R? 3 2 1 No Yes 
(d) T: RR? 3 2 1 No No 


Isomorphisms of Vector Spaces 


This section ends with a very important concept that can be a great aid in your under- 
standing of vector spaces. The concept provides a way to think of distinct vector spaces as 
being “essentially the same”—at least with respect to the operations of vector addition and 
scalar multiplication. For example, the vector spaces R* and M, , are essentially the same 
with respect to their standard operations. Such spaces are said to be isomorphic to each 
other. (The Greek word isos means “equal.”) 


One way in which isomorphic spaces are “essentially the same” is that they have 
the same dimensions, as stated in the next theorem. In fact, the theorem goes even 
further, stating that if two vector spaces have the same finite dimension, then they must be 
isomorphic. 


Two finite-dimensional vector spaces V and W are isomorphic if and only if they are of 
the same dimension. 


Assume V is isomorphic to W, where V has dimension n. By the definition of isomorphic 
spaces, you know there exists a linear transformation T: V— W that is one-to-one and onto. 
Because T is one-to-one, it follows that dim(kernel) = 0, which also implies that 


dim(range) = dim(domain) = n. 
In addition, because T is onto, you can conclude that 


dim(range) = dim(W) = n. 
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To prove the theorem in the other direction, assume V and W both have dimension n. Let 
B= {v,, V>,- . -,V,} be a basis of V, and let B’ = {w,, w5,. . ., w,,} be a basis of W. 
Then an arbitrary vector in V can be represented as 


V= CV, + CoVn + ° °° + ©,Y, 


nen? 


and you can define a linear transformation T: V— W as follows. 


T(v) = cw, + Ow, +--+ +c¢,W 


mn 


It can be shown that this linear transformation is both one-to-one and onto. So, V and W are 
isomorphic. 


Our study of vector spaces has provided much greater coverage to R” than to other vector 
spaces. This preference for R” stems from its notational convenience and from the geomet- 
ric models available for R? and R?. Theorem 6.9 tells you that R” is a perfect model for 
every n-dimensional vector space. Example 12 lists some vector spaces that are isomorphic 
to R*. 


EXAMPLE 12| Isomorphic Vector Spaces 


The vector spaces listed below are isomorphic to each other. 

(a) R* = 4-space 

(b) M,, = space of all 4 x 1 matrices 

(c) M, = space of all 2 x 2 matrices 

(d) P; = space of all polynomials of degree 3 or less 

(ec) V = {(%, x5, x3, X4, 0): x; is a real number} (subspace of R>) 


Example 12 tells you that the elements in these spaces behave the same way as vectors 
even though they are distinct mathematical entities. The convention of using the notation 
for an n-tuple and an n x 1 matrix interchangeably is justified. 


ae Rew Exercises 


In Exercises 1-10, find the kernel of the linear transformation. 9. T: R? > R?, T(x, y) = (x + 2y, y — x) 
1. T: R3—>R°, T(x, y, 2) = (0,0, 0) 10. T: R? > R?, T(x, y) = (x — y, y — x) 
2. T: R?— R?, T(x, y, z) = (x, 0, z) In Exercises 11-18, the linear transformation T is represented by 
3. T: R4—> R4, T(x, y, zw) = (9,4 wD) T(v) = Av. Find a basis for (a) the kernel of T and (b) the range of T. 
4. T: R® > R?, T(x, y, 2) = (ay. x 1 2 1 2 
(2) eo ' u.4=[ 2. 4=( 

5. T: P; R, Tay + a,x + ax? + a,x7) = ay 3. 4 -2 -4 
6. T: P, > R, Tla, a,x + a,x?) =a 1 -1 2 1 =2 1 

: eee: *) : 13. 4=[ 14. 4=[ | 
7. T: Py —>P,, Tidy + ayx + a5x?) = ay + 2ax 0 1 2 0 2 1 
8. T: P; > P,, 


2 3) 2 
T(dy + a,x + a,x? + a,xX3) = a, + 2a,x + 3a,x 
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15. A =| -1 


17. A = 


=] 
18. A = 2 
2 


In Exercises 19-30, the linear transformation T is defined by 
T(x) = Ax. Find (a) ker(7), (b) nullity(7), (c) range(T), and 


(d) rank(T). 
a | 1 
wae[t | 
1 1 
5 —3 
21.A=/1 1 
1 =1 
0 -2 
23. A= 
4 0 
oe 3 
1 ~©=10 
25. A= 3 1 
10 = 10 


tN 
“I 
. 

> 
ll 

OO a. ee OO a, ea 
| 
Oly OIF OIF 


2 
1 
4) 29. A = 
i 
6 
3 = 
43} 30.4 =|4 
iM 2 = 


In Exercises 31—38, let T: R? > R® be a linear transformation. Use 
the given information to find the nullity of T and give a geometric 


oly OIF OLR LC ———I 


1 


ole wooly wooly 


won 


2 


LO rF e 


20 


description of the kernel and range of T. 


31. rank(T) = 2 
33. rank(T) = 0 


32. rank(T) = 1 
34. rank(T) = 3 


35. 


36. 


37. 


38. 


T is the counterclockwise rotation of 45° about the z-axis: 


2, o} 2 2 
T(x, y, Z) (: ee Gk 


T is the reflection through the yz-coordinate plane: 


yz 
2? 


TQ, ¥,z) = (=x, yz) 


T is the projection onto the vector v = (1, 2, 2): 
Py te 2 
Gia=—— —t22) 


T is the projection onto the xy-coordinate plane: 
T(x, y, 2) = (x, y, 0) 


In Exercises 39-42, find the nullity of 7. 


39. 
41. 


43. 


44, 


45. 


46. 


47. 


48. 


T: R* > R?, rank(T) = 2 
T: R* > R+, rank(T) = 0 


40. T: R>— R?, rank(T) = 2 
42. T: P;—>P,, rank(T) = 2 


Identify the zero element and standard basis for each of the 
isomorphic vector spaces in Example 12. 


Which vector spaces are isomorphic to R°? 
(a) M,; (b) Pe, (c) CL, 6] 
(d) Me, (e) Ps 


(f) {(X, X>, 3, 0, X5, XG, X7): x; is a real number} 


Calculus Let T: P,—> P, be represented by T(p) = p’. What is 
the kernel of T? 


Calculus Let T: P, > R be represented by 


T(p) = [ D(x) dx. 


What is the kernel of T? 
Let T: R? > R° be the linear transformation that projects u onto 
v = (2, -1, 1). 
(a) Find the rank and nullity of T. 
(b) Find a basis for the kernel of T. 
Repeat Exercise 47 for v = (3, 0, 4). 


In Exercises 49-52, verify that the matrix defines a linear function 
T that is one-to-one and onto. 


49. 


51. 


=] 0 1 0 
a-[ 9] swa=f! 9 

0 1 0. -1 

1 0 0 1 2 3 
A=|0 0 1 52, A =| —-1 2 + 


True or False? In Exercises 53 and 54, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


53. 


54. 


55. 


56. 


(a) The set of all vectors mapped from a vector space V to 
another vector space W by a linear transformation T is 
known as the kernel of T. 

(b) The range of a linear transformation from a vector space V 
to a vector space W is a subspace of the vector space V. 

(c) A linear transformation T from V to W is called one-to-one 
if and only if for all u and v in V, T(u) = T(v) implies that 
u=v. 

(d) The vector spaces R* and M, , are isomorphic to each other. 

(a) The kernel of a linear transformation T from a vector space 
V to a vector space W is a subspace of the vector space V. 

(b) The dimension of a linear transformation T from a vector 
space V to a vector space W is called the rank of T. 

(c) A linear transformation T from V to W is one-to-one if 
the preimage of every w in the range consists of a single 
vector v. 

(d) The vector spaces R? and P, are isomorphic to each other. 

For the transformation T: R’—>R" represented by T(v) = Av, 

what can be said about the rank of T if (a) det(A) # 0 and 

(b) det(A) = 0? 

Let T: M,,,,>M,,,, be represented by T(A) = A — A’. Show 

that the kernel of T is the set of n x n symmetric matrices. 


6.3 


57. 


58. 


59. 


60. 


61. 


62. 
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Determine a relationship among m, n, j, and k such that M,,, ,, is 
isomorphic to M; ;. 


Guided Proof Let B be an invertible n x n matrix. Prove that 
the linear transformation T:M,,—>M,,,, represented by 
T(A) = AB is an isomorphism. 


Getting Started: To show that the linear transformation is 
an isomorphism, you need to show that T is both onto and 
one-to-one. 


(i) Because T is a linear transformation with vector spaces 
of equal dimension, then by Theorem 6.8, you only need 
to show that T is one-to-one. 


(ii) To show that T is one-to-one, you need to determine the 
kernel of T and show that it is {0} (Theorem 6.6). Use 
the fact that B is an invertible n x n matrix and that 
T(A) = AB. 

(iii) Conclude that T is an isomorphism. 


Let T: VW be a linear transformation. Prove that T is 
one-to-one if and only if the rank of T equals the dimension 
of V. 


Let T: V— Wbe a linear transformation, and let U be a subspace 
of W. Prove that the set T~'(U) = {v € V: T(v) € U} is a sub- 
space of V. What is T~!(U) if U = {0}? 

Writing Are the vector spaces R*, M, 5, and M, , exactly the 
same? Describe their similarities and differences. 


Writing Let 7: R"—R" be a linear transformation. Explain 
the differences between the concepts of one-to-one and onto. 
What can you say about m and n if T is onto? What can you say 
about m and n if T is one-to-one? 


Matrices for Linear Transformations 


Which representation of T: R? — R? is better, 


T(x, X>,.X3) = (2x, + xy — x3, —x, + 3x, — 2x5, 3x, + 4x3) 


or 


T(x) = Ax =| -1 


3 


—1]| x, 
—2)| x, |? 
4} Lx, 


The second representation is better than the first for at least three reasons: it is simpler to 
write, simpler to read, and more easily adapted for computer use. Later you will see that 
matrix representation of linear transformations also has some theoretical advantages. In this 
section you will see that for linear transformations involving finite-dimensional vector 
spaces, matrix representation is always possible. 
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THEOREM 6.10 


Standard Matrix for a 
Linear Transformation 


PROOF 


The key to representing a linear transformation T: V— W by a matrix is to determine how 
it acts on a basis of V. Once you know the image of every vector in the basis, you can use 
the properties of linear transformations to determine 7(v) for any v in V. 

For convenience, the first three theorems in this section are stated in terms of linear 
transformations from R” into R’”, relative to the standard bases in R” and R”. At the end of 
the section these results are generalized to include nonstandard bases and general vector 
spaces. 

Recall that the standard basis for R”, written in column vector notation, is represented by 


1 0) 0 
0 1 0) 
B= {e,6,...,¢,} = no ee 
0} Lo 1 


Let T: R" > R" be a linear transformation such that 


a1 a2 An 

a a a 
HE ea) ese | 18 Cor Nle—a pce |e aes | sb 

Ani Ang Ann 


Then the m x n matrix whose n columns correspond to 7(e;), 


Gy, Qo --- Ay 

a a oe al 
A =|! 42 2n |, 

Ant Im2 se Ann 


is such that 7(v) = Av for every v in R”. A is called the standard matrix for T. 


To show that 7(v) = Av for any v in R”, you can write 


v=] 0] =vye, +t ve, +--+ + ze 


nt 


Because T is a linear transformation, you have 
T(v) = Tye, + v.e, ++ ++ + v,€,) 
= T(v,e,) + T(v,e5) Pac ae. 28 SS T(v,e,,) 
= v,T(e,) + v,T(e,) + - > > + v,7(e,). 
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On the other hand, the matrix product Av is represented by 


Gy, 4g + + +) Ayn |} Vy AV, + Ayyvy Hs + Ay, 
— | Gor Gyn Aan | V0] _ | Ga¥y HF Aang Fo + Gy,V, 
Av =| : : : “|= : : : 
an an2 aS oe, Ann Mee ni} Tv An2V2 sa Ginn n 
ay, a1 ay, 
a a a 
_ 21 D2 ae 2n 
=v 0 | tv | + + vl): 
Ginl An? Ginn 


= v,T(e,) + v9T(e,) + > - + v,7(e,). 
So, T(v) = Av for each v in R”. 


EXAMPLE 1| _ Finding the Standard Matrix for a Linear Transformation 


Find the standard matrix for the linear transformation T: R* > R? defined by 


T(x, y, z) = (x — 2y,2x + y). 
SOLUTION Begin by finding the images of e,, e,, and e;. 


Vector Notation Matrix Notation 


a 


T(e,) = T(1, 0, 0) = (1, 2) Tle.) =T 


T(e,) = T(0, 1,0) = (—2, 1) T(e,) = T | 
T(e;) = T(0, 0, 1) = (0, 0) T(e;) = T | 


Fe coooroeoco 
| 
| 
| 
Re WY 
a 


By Theorem 6.10, the columns of A consist of T(e,), T(e,), and T(e3), and you have 


A = [T(e,) : Tle,) } T(es)] = |; = Al 
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As a check, note that 


x x 
I 2 0 x— 2y 
Aly | = i 
2 1 0 2x+ y 
z z 


which is equivalent to T(x, y, z) = (x — 2y, 2x + y). 


A little practice will enable you to determine the standard matrix for a linear transfor- 
mation, such as the one in Example 1, by inspection. For instance, the standard matrix for 
the linear transformation defined by 

T(x, X>,.X3) = (x, — 2x, + 5x3, 2x, + 3x3, 4x, + x5 — 2x3) 
is found by using the coefficients of x,,x,, and x, to form the rows of A, as follows. 
J =2 > 
A= |2 0 3 
4 1 2 


= = 1x, — 2x, + 5x; 
<= 2x, + Ox, + 3x, 


— 4x, + Ix, — 2x, 


Finding the Standard Matrix for a Linear Transformation 


SOLUTION 


> 


T(x, y) = (x, 0) 
(x, y) 


(x, 0) 
Projection onto the x-axis 


Figure 6.8 


The linear transformation T: R* > R? is given by projecting each point in R? onto the x-axis, 
as shown in Figure 6.8. Find the standard matrix for T. 


This linear transformation is represented by 
T(x, y) = (x, 0). 
So, the standard matrix for T is 


A =[T(, 0) : 7(0, 1)] 


The standard matrix for the zero transformation from R” into R” is the m x n zero 
matrix, and the standard matrix for the identity transformation from R” into R” is I,,. 


Composition of Linear Transformations 


The composition, 7, of T,: R’ > R” with T,: R” > R? is defined by 
T(v) = T,(T,(v)), 
where v is a vector in R”. This composition is denoted by 


(ce ee ee 


THEOREM 6.11 
Composition of 
Linear Transformations 


PROOF 


REMARK: Theorem 6.11 can 
be generalized to cover the 
composition of n linear transfor- 
mations. That is, if the standard 
matrices of T,,7,. . .,T7,, are 
A,,A,,. . .,A,, then the stan- 
dard matrix for the composition 
T is represented by 


A=A,A 


n**n-1 


-A,A. 


Section 6.3 Matrices for Linear Transformations 391 


The domain of T is defined as the domain of 7,. Moreover, the composition is not 
defined unless the range of T, lies within the domain of T,, as shown in Figure 6.9. 


Composition of Transformations 


Figure 6.9 


The next theorem emphasizes the usefulness of matrices for representing linear transfor- 
mations. This theorem not only states that the composition of two linear transformations is 
a linear transformation, but also says that the standard matrix for the composition is the 
product of the standard matrices for the two original linear transformations. 


Let T,:R’—R” and T,:R"—R? be linear transformations with standard matrices 
A, and A,. The composition T: R’—>R?, defined by T(v) = T,(T,(v)), is a linear 
transformation. Moreover, the standard matrix A for T is given by the matrix product 


Pe Me. 


To show that T is a linear transformation, let u and v be vectors in R” and let c be any scalar. 
Then, because 7, and T, are linear transformations, you can write 


T(u + v) = T,(T,(u + v)) 
= T,(T,(u) + T,(v)) 
= T,(T,(u)) + T,(T,(v)) = T(u) + T(y) 
T(cv) = T,(T,(cv)) 
= T,(cT,(v)) 


= cT,(T,(v)) = cT(v). 


Now, to show that A, A, is the standard matrix for T, use the associative property of matrix 
multiplication to write 


T(v) = T,(T,(v)) = T,(A,v) oa A,(A,v) = (A,Aj)v. 


392 


Chapter 6 Linear Transformations 


Because matrix multiplication is not commutative, order is important when the compo- 
sitions of linear transformations are formed. In general, the composition T, ° T; is not the 
same as T, © T,, as demonstrated in the next example. 


EXAMPLE 3| The Standard Matrix for a Composition 


Let T, and T, be linear transformations from R? into R? such that 


T(x, y,z) = (Qx+y,0,.x+z) and T(x, y,2) = — yz). 
Find the standard matrices for the compositions T = T, ° T, and T’ = T, ° 75. 


SOLUTION The standard matrices for T; and T, are 


> jf 1-1 0 
A=|0 GO 8 and A,=|0 0. 1|. 
i © ft 0 1 0 


By Theorem 6.11, the standard matrix for T is 
1 -l 0 1 0 2 1 0 
A=A,A, =|0 0 1]/|0 0) 0; =]1 0 1 
0 1 O{L1 0) 1 0 0 0 


N 


and the standard matrix for T’ is 


2 1 0 


— 
| 
— 
o 
i) 
| 
i) 
i 


— 
o 
— 
j=) 
= 
j=) 
— 
Oo 
Oo 


Another benefit of matrix representation is that it can represent the inverse of a linear 
transformation. Before seeing how this works, consider the next definition. 


Definition of Inverse ‘If 7,: R’— R” and T,: R” > R" are linear transformations such that for every v in R” 
Linear Transformation TiO) Say eed EEE 7. 


then T, is called the inverse of T,, and 7, is said to be invertible. 


Not every linear transformation has an inverse. If the transformation T, is invertible, 
however, then the inverse is unique and is denoted by 7,1. 

Just as the inverse of a function of a real variable can be thought of as undoing what the 
function did, the inverse of a linear transformation T can be thought of as undoing the map- 
ping done by T. For instance, if T is a linear transformation from R? onto R? such that 


T(1, 4, —5) = (2, 3, 1) 


THEOREM 6.12 
Existence of an 
Inverse Transformation 


EXAMPLE 4 
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and if T~! exists, then 7~! maps (2, 3, 1) back to its preimage under T. That is, 
T~*(2, 3, 1) = (1, 4, -5). 


The next theorem states that a linear transformation is invertible if and only if it is an 
isomorphism (one-to-one and onto). You are asked to prove this theorem in Exercise 78. 


Let 7: R’— R” be a linear transformation with standard matrix A. Then the following 
conditions are equivalent. 


1. T is invertible. 

2. T is an isomorphism. 

3. A is invertible. 

And, if T is invertible with standard matrix A, then the standard matrix for T~! is A~!. 


REMARK: Several other conditions are equivalent to the three given in Theorem 6.12; see 
the summary of equivalent conditions from Section 4.6. 


Finding the Inverse of a Linear Transformation 


SOLUTION 


The linear transformation T: R* — R? is defined by 
This Hoy He) = (2 He By Hy By Bey HP Mas 28, Ay PD. 
Show that 7 is invertible, and find its inverse. 


The standard matrix for T is 


2 3 1 
A=13 3 1 
2 4 1 


Using the techniques for matrix inversion (see Section 2.3), you can find that A is invertible 
and its inverse is 


=] 1 0 
A'=|-1 0 1}; 
6 =2' 35 


So, T is invertible and its standard matrix is A~!. 
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Transformation Matrix for 
Nonstandard Bases 


Using the standard matrix for the inverse, you can find the rule for T~! by computing 
the image of an arbitrary vector v = (x,, x,, x3). 


-1 1 0} | x, a ame 
Aly =|-1 0 L}}x,| =] -x, + Xx, 
6 =2 =3/L% 6x, — 2x, — 3x5 


In other words, 


T 7! (x1, X5,.%3) = (Hx + 2X5, — x, + x3, 6x, — 2x, — 3x5). 


Nonstandard Bases and General Vector Spaces 


You will now consider the more general problem of finding a matrix for a linear 
transformation 7: V— W, where B and B’ are ordered bases for V and W, respectively. 
Recall that the coordinate matrix of v relative to B is denoted by [v],. In order to represent 
the linear transformation T, A must be multiplied by a coordinate matrix relative to B. The 
result of the multiplication will be a coordinate matrix relative to B’. That is, 


[7(v)]5, = ALv]s- 


A is called the matrix of T relative to the bases B and B’. 

To find the matrix A, you will use a procedure similar to the one used to find the 
standard matrix for T. That is, the images of the vectors in B are written as coordinate 
matrices relative to the basis B’. These coordinate matrices form the columns of A. 


Let V and W be finite-dimensional vector spaces with bases B and B’, respectively, where 
B= hye 3 a9 Glee 


If 7: V— Wis a linear transformation such that 


ay, ab) Uy 

a a a 
[T(v,) |p. = ‘si > [T(vo) lp = . a8 6 oh [T(v,,) le. aa os > 

oe ae ae, 


then the m x n matrix whose n columns correspond to [T(v,)],. 


4, Yo --- Uy 

Ay, Ann «1 +--+ A 
AS |S: au F 

ant an2 certs Ginn 


is such that [7(v)],, = Alv], for every v in V. 


EXAMPLE 5 


Section 6.3 Matrices for Linear Transformations 395 


Finding a Matrix Relative to Nonstandard Bases 


SOLUTION 


EXAMPLE 6 


Let T: R* > R? be a linear transformation defined by 
T(x, X>) = (x) + x5, 2x, — x). 
Find the matrix for T relative to the bases 
Vv V Ww; W> 
B = {(1, 2), (-1, 1)} and B’ = {(1, 0), (0, 1)}. 
By the definition of T, you have 


T(v,) = TU, 2) = (3,0) = 3w, + Ow, 
T(v,) = T(—1, 1) = (0, —3) = Ow, — 3w. 


The coordinate matrices for T(v,) and T(v,) relative to B’ are 


[rw le =[5] ard [rte =| 3] 


The matrix for T relative to B and B’ is formed by using these coordinate matrices as 
columns to produce 


ale 


Using a Matrix to Represent a Linear Transformation 


SOLUTION 


For the linear transformation T: R* > R? from Example 5, use the matrix A to find 7(v), 
where v = (2, 1). 


Using the basis B = {(1, 2), (—1, 1)}, you find 
v = (2, 1) = 1(1, 2) — 1(-1, 1), 


which implies 


ve [] 


So, [T(v)],- is 


aon=[ SIL tJ-Li]=toe 


Finally, because B’ = {(1, 0), (0, 1)}, it follows that 
T(v) = 3(1, 0) + 3(0, 1) = (3, 3). 
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EXAMPLE 7 


You can check this result by directly calculating 7T(v) using the definition of T from 
Example 5: 


7(2, 1) = (2 + 1,2(2) — 1) = (3,3). 


In the special case where V = W and B = B’, the matrix A is called the matrix of T 
relative to the basis B. In such cases the matrix of the identity transformation is simply J,,. 
To see this, let B = {v,, V.,. . ., V,,}. Because the identity transformation maps each v, to 
itself, you have 


1 0 0 
[we =|° hroale =| 2b. Lee =] ° | 
0 0 i 


and it follows that A = /,. 
In the next example you will construct a matrix representing the differential operator 
discussed in Example 10 in Section 6.1. 


A Matrix for the Differential Operator (Calculus) 


SOLUTION 


Let D,: P,P, be the differential operator that maps a quadratic polynomial p onto its 
derivative p’. Find the matrix for D, using the bases 


B ={l,x,x?} and B’= {1, x}. 
The derivatives of the basis vectors are 
D,() = 0 = O(1) + 0) 
1(1) + O(@) 


D(x) = 1 
D(x?) = 2x = 011) + 2(x). 


So, the coordinate matrices relative to B’ are 


[Dy = |p} Oe =| 5} Dee =|} 


and the matrix for D, is 


0 1 0 
A=| | 
0 0 2 
Note that this matrix does produce the derivative of a quadratic polynomial p(x) = 
a+ bx + cx?. 


w= [od Wel =[ 8] oe b+ 2er= Dia toe 
p 0 0 ) 56 Cx La X + CX 
G 
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aN Reeee Exercises 


In Exercises 1—10, find the standard matrix for the linear transfor- 
mation 7. 


. T(x, y, 2) = (32 — 2y, 4x + 112) 
. T(x, y,z) = (3x — 2z, 2y — 2) 

» T(x, Xp, X3, X4) = (0, 0, 0, 0) 

. T(x}, X5, x3) = (0, 0, 0) 


1. T(x, y) = (x + 2y, x — 2y) 

2. T(x, y) = (8x + 2y, 2y — x) 

3. T(x, y) = (2x — 3y,x — y,y — 4x) 

4. T(x, y) = (4x + y, 0, 2x — 3y) 

5. T(x, y,z) = («+ y,x —y,z— x) 

6. T(x, y, 2) = (5x — 3y + z, 2z + 4y, 5x + 3y) 
7 

8 

9 


—_ 
—] 


In Exercises 11-16, use the standard matrix for the linear transfor- 
mation T to find the image of the vector v. 


11. T(x, y, z) = (13x — 9y + 4z, 6x + S5y — 3z), v = (1, —2, 1) 
12. T(x, y, z) = (2x + y, 3y — z), v = (0,1, —1) 

13. T(x, y) = (x + y,x — y, 2x, 2y), v = (3, —3) 

14. T(x, y) = (x — y,x + 2y, y), v = (2, —2) 

15. T(X,, X,%3, X4) = (x, + xy,x; + x4), V= (1, -1,1,-1) 


16. T(x), X>, X35, X4) = (2x, — x3, 3x, — 4x4, 4x, — X1, X + x4), 
v = (1, 2, 3, —2) 
In Exercises 17-34, (a) find the standard matrix A for the linear 


transformation 7, (b) use A to find the image of the vector v, and 
(c) sketch the graph of v and its image. 


17. T is the reflection through the origin in R?: T(x, y) = (—x, —y), 
v = (3, 4). 


18. T is the reflection in the line y = x in R*: T(x, y) = (y, »), 
v = (3,4). 


19. T is the reflection in the y-axis in R?: T(x, y) = (—x,y), 
v = (2, —3). 


20. T is the reflection in the x-axis in R*: T(x, y) = (x, —y), 
v = (4, --1). 


21. Tis the counterclockwise rotation of 135° in R?, v = (4, 4). 
22. Tis the counterclockwise rotation of 120° in R?, v = (2, 2). 


23. T is the clockwise rotation (@ is negative) of 60° in R?, 
v = (1, 2). 


24. T is the clockwise rotation (@ is negative) of 30° in R?, 
v = (2, 1). 


25. 


26. 


27. 


28. 
29. 
30. 
31. 


32. 


33. 


34. 


T is the reflection through the xy-coordinate plane in 
R3: T(x, y, z) = (x, y, —2z), V = (3, 2, 2). 

T is the reflection through the yz-coordinate plane in 
R3: T(x, y, 2) = (—x, y, z), V = (2, 3, 4). 

T is the reflection through the xz-coordinate plane in 
R3: T(x, y, z) = (x, —y, z), v = (1, 2, —1). 


T is the counterclockwise rotation of 45° in R*, v = (2, 2). 


T is the counterclockwise rotation of 30° in R*, v = (1, 2). 

T is the counterclockwise rotation of 180° in R*, v = (1, 2). 

T is the projection onto the vector w = (3, 1) in R?: T(v) = 
proj,v, v = (1, 4). 

T is the projection onto the vector w= (—1,5) in R?: 
T(v) = proj,v, v = (2, —3). 

T is the reflection through the vector w = (3,1) in R?, 
v = (1,4). [The reflection of a vector v through w is 
T(v) = 2 projyv — v.] 

Repeat Exercise 33 for w = (4, —2) and v = (5, 0). 


4) In Exercises 35-38, (a) find the standard matrix A for the linear 

(pM transformation 7, (b) use A to find the image of the vector v, and (c) 
use a graphing utility or computer software program and A to verify 
your result from part (b). 


35. 


36. 


37. 


38. 


T(x, y, z) = (2x + 3y — z, 3x — 2z,2x —y + 2), 
v =(1,2,-1) 

T(x, y, z) = (3x — 2y + z, 2x — 3y, y — 42), 

v = (2,-1, -1) 


T(x, Xp, X3, x4) = (x, — Xp, X3, Xy + 2X. — Xy, X4)s 
v = (1,0, 1,-1) 

T Xs X95 X55. Xy) = (Ky + 2k, Hy — Hyp 2Hq — Xs X), 
v = (0, 1,—1, 1) 


In Exercises 39-44, find the standard matrices for T = T, ° T, and 


T’= 
39. 


40. 


41. 


Ret, 
T,: R°— R?, T,(x, y) = (x — 2y, 2x + 3y) 
T,: R°-» R*, To(x, y) = (2x, x — y) 
T,: R? > R?, T,(x, y) = (x — 2y, 2x + 3y) 
T>: R? > R2, T,(x, y) = (y, 0) 

T,; BR, T,(x, y,2) =, y, 2) 

Ty: R° > R?, T,(x, y, 2) = (0, x, 0) 
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42. T,: R7 > R?, T,(x, y, z) = (x + 2y, y — z, —2x + y + 22) 
Ty: R37 R?, T>(x, y, z) = (y + zx + z, 2y — 22) 

43. T,: R?-> R3, T,(x, y) = (—x + 2y,x + y,x — y) 
Ty: R? > R?, T>(x, y, 2) = (x — 3y, z + 3x) 


44, T,: R? > R3,T,(x, y) = (wy. y) 
Tp: R3 > R2, T,(x, y, 2) = (9,2) 


In Exercises 45-56, determine whether the linear transformation is 
invertible. If it is, find its inverse. 


45. T(x, y) = (x + y,x — y) 
46. T(x, y) = (x + 2y, x — 2y) 


AT. T(X1, Xo, X3) = (%1, 41 + XX, + X_ + 2X3) 


48. T(x), X5, X3) = (4, + x5, X) + X3, xX, + 2X3) 
49. T(x, y) = (2x, 0) 

50. T(x, y) = (0, —y) 

51. T(x, y) = (x + y, 3x + 3y) 

52. T(x, y) = (x + 4y, x — 4y) 

53. T(x, y) = (5x, Sy) 

54. T(x, y) = (—2x, 2y) 


55. T(x), X95 X35 X4) = (x, — 2X4, Xo, X3 + Xy, X3) 


56. T(x,, Xo, X35 Xq) = (%4, Xys Xp, X1) 


In Exercises 57—64, find 7(v) by using (a) the standard matrix and 
(b) the matrix relative to B and B’. 
57. T: R?->R?, T(x, y) = (x + y, x,y), v = (5, 4), 
B = {(, —1), (0, 1)}, B’ = {G, 1, 0), (0, 1, 1), C1, 0, 1)} 
58. T: R? > R3, T(x, y) = (x — y,0,x + y), v = (—3, 2), 
B = {(1, 2), (1, D}, B’ = {(1, 1, 1), , 1, 0), (0, 1, 1)} 
59. T: RP’ R?, T(x, y,z) = (x — y,y — 2), v= (1, 2, —3), 
B= {(, 1, 1), (, 1, 0), (0, 1, 1)}, B’ = {(, 2), (1, 1)} 
60. T: R? > R?, T(x, y, z) = (2x — z,y — 2x), v = (0, —5, 7), 
B = {(2, 0, 1), (0, 2, 1), , 2, 1)}, B’ = {, 1), (2, 0)} 
61. T: R? > R+, T(x, y, z) = (Qx,x+ y,y +z,x +2), 
v = (1, —5, 2), 
B = {(2,0, 1), (0, 2, 1), (1, 2, 1)}, 
B’ = {(1, 0, 0, 1), (0, 1, 0, 1), (1, 0, 1, 0), (1, 1, 0, 0)} 
62. T: R*> R?, T(x,, X5, X35 %4) = (Hy +X FX + Xy,%4 — X,), 
v = (4, —3, 1, 1), 
B = {(1, 0, 0, 1), (0, 1, 0, 1), (1, 0, 1, 0), (1, 1, 0, 0)}, 
B= {(1, 1), 2,.0)} 


63. T: R? > R?, T(x, y, z) = (x + y + z, 2z — x, 2y — 2), 
v = (4, —5, 10), 
B = {(2,0, 1), (0, 2, 1), (1, 2, I}, 
B’ = {(1, 1, 1), (, 1, 0), (0, 1, 1)} 

64. T: R? > R?, T(x, y) = (2x — 12y, x — 5y), v = (10, 5), 
B=B’'= {(4, 1), 3, 1} 


65. Let T: P; > P, be given by T(p) = xp. Find the matrix for T 
relative to the bases B = {1, x, x7} and B’ = {1, x, x?, x}. 

66. Let T: P,P, be given by T( p) = x?p. Find the matrix for T 
relative to the bases B = {1, x, x2} and B’ = {1, x, x7, x3, x4}. 


67. Calculus Let B = {1, x, e*, xe*} be a basis of a subspace W of 
the space of continuous functions, and let D,, be the differential 
operator on W. Find the matrix for D, relative to the basis B. 


68. Calculus Repeat Exercise 67 for B = {e?*, xe**, xe}. 


69. Calculus Use the matrix from Exercise 67 to evaluate 
D[3x — 2xe*]. 


70. Calculus Use the matrix from Exercise 68 to evaluate 
D [5e** — 3xe?* + x?e*]. 


71. Calculus Let B = {1,x,x°,x°} be a basis for P3, and let 
T: P,— P., be the linear transformation represented by 


T(x’) = [ t* dt. 
0 


(a) Find the matrix A for T with respect to B and the 
standard basis for P,. 
(b) Use A to integrate p(x) = 6 — 2x + 3x°. 


True or False? In Exercises 72 and 73, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


72. (a) If T is a linear transformation R” to R”, the m x n matrix A 
is called the standard matrix such that 7(v) = Av for every 
vin R". 
(b) The composition T of linear transformations 7, and T,, 
defined by T(v) = T,(T,(v)), has the standard matrix A 
represented by the matrix product A = A,A,. 


(c) All linear transformations T have a unique inverse T~!. 


73. 


74. 


75. 


76. 


77. 
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(a) The composition T of linear transformations T, and T,, need to use Theorems 6.8 and 6.12 to show that T is invertible, 
represented by T(v) = T,(T,(v)), is defined if the range of and then show that T°(T,~! ° T,"') and (T,! ° Ty!) ¢ T are 
T, lies within the domain of T,. identity transformations. 
(b) In general, the compositions T, °T, and T, ° T, have the (i) Let T(u) = T(v). Recall that (7, ° T,)(v) = T,(T,(v)) 
same standard matrix A. for all vectors v. Now use the fact that T, and T, are 
(c) If 7: R°—R" is an invertible linear transformation with one-to-one to conclude that u = v. 
standard matrix A, then T~! has the same standard matrix A. (ii) Use Theorems 6.8 and 6.12 to show that 7,, T,, and T 
Let T be a linear transformation such that 7(v) = kv for vin R”. are all invertible transformations. So T;"' and T,"' 
Find the standard matrix for 7. exist. 
Let T:M,,—>M,, be represented by T(A) = A’. Find the (iii) Form the composition T’ = T,;-! ° T, 1. It is a linear 
matrix for T relative to the standard bases for M, , and M; ,. transformation from V to V. To show that it is the 
Show that the linear transformation T given in Exercise 75 is an inverse of T, you Hees to determine whether the Compo" 
isomorphism, and find the matrix for the inverse of T. sition of T with T” on both sides gives an identity 
transformation. 
Guided Proof Let 7,:V-V and T,:V—V be one-to-one 78. Prove Theorem 6.12. 


linear transformations. Prove that the composition T = T, ° T, 


is aneste-one-and that’! exists and isequal oT? <1, 79. Writing Is it always preferable to use the standard basis for 


R"? Discuss the advantages and disadvantages of using different 
Getting Started: To show that T is one-to-one, you can bases. 


use the definition of a one-to-one transformation and show that 


. ; 80. Writin Look back at Th 4.19 and rephrase it in t 
T(u) = T(v) implies u = v. For the second statement, you first Se ee cael aca ies 


of what you have learned in this chapter. 


Transition Matrices and Similarity 


In Section 6.3 you saw that the matrix for a linear transformation 7: V—> V depends on the 
basis of V. In other words, the matrix for T relative to a basis B is different from the matrix 
for T relative to another basis B’. 

A classical problem in linear algebra is this: Is it possible to find a basis B such that the 
matrix for T relative to B is diagonal? The solution of this problem is discussed in Chapter 
7. This section lays a foundation for solving the problem. You will see how the matrices for 
a linear transformation relative to two different bases are related. In this section, A, A’, P, 
and P~! represent the four square matrices listed below. 


1. Matrix for T relative to B: A 
2. Matrix for T relative to B’: A’ 
3. Transition matrix from B’ to B: Pe 
4. Transition matrix from B to B’: ps 


Note that in Figure 6.10 there are two ways to get from the coordinate matrix [v],,, to 
the coordinate matrix [7(v)],.. One way is direct, using the matrix A’ to obtain 


A’[v]e = [TW)]p- 
The other way is indirect, using the matrices P, A, and P~! to obtain 


P™'APLv]y, = [T(v) Jp 
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But by the definition of the matrix of a linear transformation relative to a basis, this implies 
that 


A’ = P-lAP. 


This relationship is demonstrated in Example 1. 


V . V 
(Basis B) 


=) 
| 


(Basis B’) 


Vv Vv 


Figure 6.10 


EXAMPLE 1|_ Finding a Matrix of a Linear Transformation 


Find the matrix A’ for T: R? > R?, 


T(x, 45) = (2x, = 2x5, —x, + 3x4), 
relative to the basis B’ = {(1, 0), (1, 1)}. 


SOLUTION The standard matrix for T is 


a-[ Gl 


Furthermore, using the techniques of Section 4.7, you can find that the transition matrix 
from B’ to the standard basis B = {(1, 0), (0, 1)} is 


P=lo af 


The inverse of this matrix is the transition matrix from B to B’, 


p=[! | 
0 a 


The matrix for T relative to B’ is 


verwe[l WG UL 
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In Example 1, the basis B is the standard basis for R?. In the next example, both B and B’ 
are nonstandard bases. 


EXAMPLE 2|_ Finding a Matrix for a Linear Transformation 


Let 


B = {(—3, 2), (4,-2)} and B’= {(-1, 2), (2, —2)} 


be bases for R?, and let 


a-[3 J] 


be the matrix for 7: R? > R? relative to B. Find A’, the matrix of T relative to B’. 


SOLUTION In Example 5 in Section 4.7, you found that 
and 


So, the matrix of T relative to B’ is 
—] 2|{/-2 7\|[3. =2 2 1 
A’ =P AP = = ; 
—2 3) L-3 FAL <1 —1 3 


The diagram in Figure 6.10 should help you to remember the roles of the matrices 
A, A’, P, and P~}. 


EXAMPLE 3| Using a Matrix for a Linear Transformation 


For the linear transformation T: R*—> R? from Example 2, find [v],, [7(v)],, and [T(v)],- 
for the vector v whose coordinate matrix is 


[3 


SOLUTION To find [v],, use the transition matrix P from B’ to B. 


= Ale =|> | [-a]=|_5| 


To find [7(v)],, multiply [v], by the matrix A to obtain 


roam [2 3-3 
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To find [7(v)],-, multiply [7(v)], by P~! to obtain 


ere = etal, = [42] [724] -[-7] 


or multiply [v],, by A’ to obtain 


mo =artwle=[_¢ all-tl= [ch 


REMARK: It is instructive to note that the transformation T in Examples 2 and 3 is 
represented by the rule 7(x, y) = (x = 3 y, 24+ 4y). Verify the results of Example 3 by 
showing that v = (1, —4) and 7(v) = (7, — 14). 


Similar Matrices 


Two square matrices A and A’ that are related by an equation A’ = P~'!AP are called 
similar matrices, as indicated in the next definition. 


Definition of For square matrices A and A’ of order n, A’ is said to be similar to A if there exists an 
Similar Matrices invertible matrix P such that A’ = P~!AP. 


If A’ is similar to A, then it is also true that A is similar to A’, as stated in the next 
theorem. So, it makes sense to say simply that A and A’ are similar. 


THEOREM 6.13 — Let A, B, and C be square matrices of order n. Then the following properties are true. 


Properties of 1. A is similar to A. 
Similar Matrices 2. If A is similar to B, then B is similar to A. 
3. If A is similar to B and B is similar to C, then A is similar to C. 


PROOF The first property follows from the fact that A = J, AI. To prove the second property, write 


A = P-'BP 
PAP-! = P(P~'BP)P~! 
PAP-! = B 


Q-'AQ = B, where Q = P™!. 
The proof of the third property is left to you. (See Exercise 23.) 


EXAMPLE 4 
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From the definition of similarity, it follows that any two matrices that represent the same 
linear transformation T: V— V with respect to different bases must be similar. 


Similar Matrices 


EXAMPLE 5 


(a) From Example 1, the matrices 
2 -2 3. -=2 
A= and A’= 
—1 3 =i] 2 
sts = 1 1 
are similar because A’ = P~!AP, where P = 0 : 
(b) From Example 2, the matrices 
= 2. 7 2 1 
A= and A’= 
=3 7 = 3 


3. =2 
are similar because A’ = P~'!AP, where P = 5 | 


You have seen that the matrix for a linear transformation T: V— V depends on the basis 
used for V. This observation leads naturally to the question: What choice of basis will make 
the matrix for T as simple as possible? Is it always the standard basis? Not necessarily, as 
the next example demonstrates. 


A Comparison of Two Matrices for a Linear Transformation 


SOLUTION 


Suppose 
1 3 0 
A=}3 1 0 
0 0 -2 


is the matrix for T: R? > R° relative to the standard basis. Find the matrix for T relative to 
the basis 


B’ = {(1, 1, 0), (1, 1, 0), (0, 0, 1)}. 
The transition matrix from B’ to the standard matrix has columns consisting of the vectors 
in B’, 
1 1 0 
P=)1 -1 0}, 
0 0 1 
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and it follows that 


> 2 0 
P%s|o =; 6 
0 0 1 


So, the matrix for T relative to B’ is 


A’= P-!AP 

1 1g 
> 3 1 3 Ovf1 1 0 

=|; -+ o]/3 1 oOff1 -1 0 
0 o 1.{LO9 O -2J3L0 O 1 
4 0 0 

=|0 -2 Ol. 
0 oO -2 


Note that matrix A’ is diagonal. 


Diagonal matrices have many computational advantages over nondiagonal ones. For 
instance, for the diagonal matrix 


d, 0 --- 0 
pel ee 2 
6 6 xe wo 
the kth power is represented as follows. 
‘ai’ 0 a cig ia @) 
jie 0 dy eas 0 


A diagonal matrix is its own transpose. Moreover, if all the diagonal elements are nonzero, 
then the inverse of a diagonal matrix is the matrix whose main diagonal elements are the 
reciprocals of corresponding elements in the original matrix. With such computational 
advantages, it is important to find ways (if possible) to choose a basis for V such that the 
transformation matrix is diagonal, as it is in Example 5. You will pursue this problem in 
the next chapter. 
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aeNe Rees Exercises 


In Exercises 1—8, (a) find the matrix A’ for T relative to the basis 
B’ and (b) show that A’ is similar to A, the standard matrix for T. 
1. T: R? > R?, T(x, y) = (2x — y,y — x), B’ = {(1, —2), (0, 3)} 
2. T: R? > R?, T(x, y) = (2x + y,x — 2y), B’ = {(, 2), (0, 4)} 
3. T: R? > R?, T(x, y) = (x + y, 4y), B’ = {(-4, J, 0, — 
4 
5 


. T: R? > R*, T(x, y) = (« — 2y, 4x), B’ = {(—2, 1), (—1, 1} 
. T: R? > R?, T(x, y, 2) = (x, y, 2), 
B’ = {(1, 1, 0), (1, 0, 1), (0, 1, 1)} 
. T: RB’ R?, T(x, y, z) = (0, 0, 0), 
B’ = {(1, 1, 0), (, 0, 1), (0, 1, 1)} 
7. T: BR, T(x, y,z) =(x —y+2z,2x+y—zx+2y+2), 
B’ = {(1, 0, 1), (0, 2, 2), (1, 2, 0)} 
8. T: R? > R?, T(x, y, z) = (x, x + 2y,x + y + 32), 
B’ = {(1, —1, 0), (0, 0, 1), (0, 1, — 1)} 


a 


‘eo 


. Let B = {(1, 3), (—2, —2)} and B’ = {(—12, 0), (-4, 4)} be 
bases for R2, and let 


lo al 
A= 
0 4 
be the matrix for T: R? > R? relative to B. 
(a) Find the transition matrix P from B’ to B. 


(b) Use the matrices A and P to find [v], and [7(v)],, 
where 


Lv], = | | 
(c) Find A’ (the matrix for T relative to B’) and P~!. 
(d) Find [7(v)],, in two ways: first as P~![T(v)], and then 
as A’[v],,. 
10. Repeat Exercise 9 for B = {(1, 1), (—2,3)}, B’ = {(, —-1), 
(0, 1)}, and 


1 
[v]_ = | 3 (Use matrix A provided in Exercise 9.) 


11. Let B= {(1, 1,0), (1,0, 1), (0,1, 1)} and B’= {(1,0,0), 
(0, 1, 0), (0, 0, 1)} be bases for R3, and let 


3 1 
qt sg 
1 1 
A=] -3 2 3 
1 5 
7 1 3 


be the matrix for T: R? > R? relative to B. 


(a) Find the transition matrix P from B’ to B. 
(b) Use the matrices A and P to find [v], and [7(v)],, 


where 
1 
Lv], = 0}. 
—1 


(c) Find A’ (the matrix for T relative to B’) and P~!. 
(d) Find [7(v)],- in two ways: first as P~'[7(v)], and then 
as A’[v], 
12. Repeat Exercise 11 for B = {(1, 0, 0), (0, 1, 0), (0, 0, 1)}, 
B’= {(1,1, -1), (1, -1, 1), (-1, 1, 1}, and 


2 
[v]z, = | 1 |. (Use matrix A provided in Exercise 11.) 
1 


13. Let B = {(1,2),(—1, -1)} and B’ = {(-4, 1), (0, 2)} be 
bases for R?, and let A = F _ 1 be the matrix for T: R? > R2 
relative to B. 

(a) Find the transition matrix P from B’ to B. 

(b) Use the matrices A and P to find [v], and [7(v) ],, where 


tle =| 4 


(c) Find A’ (the matrix for T relative to B’) and P~!. 
(d) Find [7(v)],- in two ways: first as P~'[7(v)], and then 
as A’[(v)],-- 


14, Repeat Bat, =) (=2,.1)) 


B’ = {(-1, 1), (, 2)}, and [v],,= || (Use matrix A 


Exercise 13 for 


provided in Exercise 13.) 


15. Prove that if A and B are similar, then |A| = |B]. Is the converse 
true? 


16. Illustrate the result of Exercise 15 using the matrices 


1 0 0 11 7 10 
A= |0 =2 0}, B= 10 8 10}, 
0 0 3 =18 -12 =17 
=] 1 0 =]. =1 2 
p= 2 1 2|,P l= 0 -1 2s 
1 1 1 1 2, 3 


where B = P~'!AP. 
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17. 


18. 


19. 
20. 


21. 


22. 
23. 


24. 


25. 
26. 


27. 


28. 


Let A and B be similar matrices. 
(a) Prove that A’ and B’ are similar. 


(b) Prove that if A is nonsingular, then B is also nonsingular 
and A~! and B~! are similar. 


(c) Prove that there exists a matrix P such that 


BE = P-AFP. 
Use the result of Exercise 17 to find B*, where B = P~!AP for 
the matrices 


1 = = 
tela ak @eD 2 oh 
0 2 2 #7 
2 ay 
pelt oak veka ol 
t 3 ={ 2 


Determine all n x n matrices that are similar to J,,. 


Prove that if A is idempotent and B is similar to A, then B is 
idempotent. (Ann x n matrix A is idempotent if A = A2.) 


Let A be an n X n matrix such that A? = O. Prove that if B is 
similar to A, then B? = O. 


Let B = P~'!AP. Prove that if Ax = x, then PBP~!x = x. 


Complete the proof of Theorem 6.13 by proving that if A is 
similar to B and B is similar to C, then A is similar to C. 


Writing Suppose A and B are similar. Explain why they have 
the same rank. 


Prove that if A and B are similar, then A? is similar to B?. 


Prove that if A and B are similar, then A‘ is similar to B* for any 
positive integer k. 


Let A = CD, where C is an invertible n x n matrix. Prove that 
the matrix DC is similar to A. 


Let B = P~'AP, where B is a diagonal matrix with main 
diagonal entries b,,, by5,. . ., D,,,- Prove that 


- 9 “nn 


Gy, 4g 2 + + Ay] | Pi Pui 

41 492+ + Fan) | Pri! = p | Pri 
: : : : ii} « |> 

ant a2 Be 8 SS Gain Pri Pni 


fori=1,2,...,n. 


29. Writing Let B= {v,,v,,.. .,v,,} be a basis for the vector 
space V, let B’ be the standard basis, and consider the identity 
transformation J: V— V. What can you say about the matrix for 
T relative to both B and B’ ? What can you say about the matrix 
for J relative to B? Relative to B’? 


True or False? In Exercises 30 and 31, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


30. (a) The matrix for a linear transformation A ’ relative to the basis 
B’ is equal to the product P~'AP, where P~! is the transi- 
tion matrix from B to B’, A is the matrix for the linear 
transformation relative to basis B, and P is the transition 
matrix from B’ to B. 


(b) Two matrices that represent the same linear transformation 
T: VV with respect to different bases are not necessarily 
similar. 

31. (a) The matrix for a linear transformation A relative to the basis 
B is equal to the product PA ’P~', where P is the transition 
matrix from B’ to B, A’ is the matrix for the linear transfor- 
mation relative to basis B’, and P~! is the transition matrix 
from B to B’. 


(b) The standard basis for R” will always make the coordinate 
matrix for the linear transformation T the simplest matrix 
possible. 


Elementary Matrices 
for Linear Transformations 
in the Plane 


EXAMPLE 1 
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6.5 


Applications of Linear Transformations 


The Geometry of Linear Transformations in the Plane 


This section gives geometric interpretations of linear transformations represented by 2 x 2 
elementary matrices. A summary of the various types of 2 x 2 elementary matrices is 
followed by examples in which each type of matrix is examined in more detail. 


Reflection in y-Axis 


=| 0 
Ae 
0 1 
Horizontal Expansion (k > 1) 
or Contraction (0 < k < 1) 


Reflection in x-Axis 


Soy 


Vertical Expansion (k > 1) 
or Contraction (0 < k < 1) 


Reflection in Line y = x 


ola 


Vertical Shear 


“fd 


Horizontal Shear 


“ld 


Reflections in the Plane 


The transformations defined by the matrices listed below are called reflections. Reflections 
have the effect of mapping a point in the xy-plane to its “mirror image” with respect to one 
of the coordinate axes or the line y = x, as shown in Figure 6.11. 


(a) (b) (c) 


So 
< 
z 
Z 
S 
< 
qj 


> X 


(x, —y) 


Reflections in the Plane 


Figure 6.11 
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(a) Reflection in the y-axis: 
Nx) = (=a) 
bo bI-ES 
0 lI Ly y 
(b) Reflection in the x-axis: 


T(x, y) = (x, —y) 


lo -llt=LI 


(c) Reflection in the line y = x: 


T(x, y) = (y, x) 


EXAMPLE 2|_ Expansions and Contractions in the Plane 


The transformations defined by the matrices below are called expansions or contractions, 
depending on the value of the positive scalar k. 


(a) Horizontal contractions and expansions: 


T(x, y) = (kx, y) 


lL 


(b) Vertical contractions and expansions: 


T(x, y) = (x, ky) 


lo alls Le 


Note that in Figures 6.12 and 6.13, the distance the point (x, y) is moved by a contraction 
or an expansion is proportional to its x- or y-coordinate. For instance, under the transforma- 
tion represented by 7(x, y) = (2x, y), the point (1, 3) would be moved one unit to the right, 
but the point (4, 3) would be moved four units to the right. 
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y y 
A A 
(kx,y) (x,y) a cL Gy) (kx, y) 
° e e 
> Xx > xX 
Contraction (0 <k < 1) Expansion (k > 1) 
Figure 6.12 
y y 
A cy 4 (x, ky) 
eo (x, y) (x, y) 
sb) <> 
> xX > xX 
Contraction (0<k < 1) Expansion (k > 1) 
Figure 6.13 


The third type of linear transformation in the plane corresponding to an elementary matrix 
is called a shear, as described in Example 3. 


EXAMPLE 3 Shears in the Plane 


The transformations defined by the following matrices are shears. 


T(x, y) = (x + ky, y) T(x, y) = (x,y + ka) 


Le llt=Les I 


+», (a) The horizontal shear represented by T(x, y) = (x + 2y, y) is shown in Figure 6.14. 
Under this transformation, points in the upper half-plane are “sheared” to the right by 
MS ncaa *, amounts proportional to their y-coordinates. Points in the lower half-plane are “sheared” 
to the left by amounts proportional to the absolute values of their y-coordinates. Points 
Figure 6.14 on the x-axis are unmoved by this transformation. 


y 


ay) &+2y,9) | ‘| Hl [* + | 
T @------5  Y = 
OAL y 


e 
t 
1 
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Figure 6.15 


(x, y, Z) x’, y’, 2’) 


e 
1 
1 
1 
1 
T 
1 
1 
1 
1 
1 
1 
v 


x y 


EXAMPLE 4 


Figure 6.16 


(b) The vertical shear represented by T(x, y) = (x, y + 2x) is shown in Figure 6.15. Here, 
points in the right half-plane are “sheared” upward by amounts proportional to their 
x-coordinates. Points in the left half-plane are “sheared” downward by amounts propor- 
tional to the absolute values of their x-coordinates. Points on the y-axis are unmoved. 


Computer Graphics 


Linear transformations are useful in computer graphics. In Example 7 in Section 6.1, you 
saw how a linear transformation could be used to rotate figures in the plane. Here you will 
see how linear transformations can be used to rotate figures in three-dimensional space. 

Suppose you want to rotate the point (x, y, z) counterclockwise about the z-axis through 
an angle 6, as shown in Figure 6.16. Letting the coordinates of the rotated point be 
(x’, y’4,z’), you have 


x: cos@ —sinéd Ollx xcos @— ysin 0 
y’| =] sind cos@ Ol}; y| =|xsin 6+ ycos 6]. 
2 0 0 Iz i 


Example 4 shows how to use this matrix to rotate a figure in three-dimensional space. 


SOLUTION 


Figure 6.17 


Rotation About the z-Axis 

The eight vertices of a rectangular box having sides of lengths 1, 2, and 3 are as follows. 
Vv, a (0, 0, 0), Vy = (1, 0, 0), V; = (i, 2; 0), Vv, = (0, 2, 0), 
V; = (0, 0, 3), V; = (1, 0, 3), V, = (1, 2, 3), Ve = (0, 2, 3) 


Find the coordinates of the box when it is rotated counterclockwise about the z-axis through 
each angle. 


(a) 6 = 60° (b) 6 = 90° (c) 6 = 120° 
The original box is shown in Figure 6.17. 


(a) The matrix that yields a rotation of 60° is 


cos 60° —sin60° 0 1/2 -—./3/2 0 
A=] sin60° cos60° 0]=| /3/2 1/2 0}. 
0 Oo «i 0 0 1 
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Multiplying this matrix by the eight vertices produces the rotated vertices listed below 


Original Vertex Rotated Vertex 

V, = (0, 0, 0) (0, 0, 0) 
V, = (1, 0, 0) (0.5, 0.87, 0) 
V; = (1, 2, 0) (— 1.23, 1.87, 0) 
V, = (0, 2, 0) (1.735. 1.0) 
V; = (0, 0, 3) (0, 0, 3) 
V, = (1, 0, 3) (0.5, 0.87, 3) 
V, = (1, 2, 3) (1.23, 1,87, 3) 
V, = (0, 2, 3) (—1:73,-1,9) 


A computer-generated graph of the rotated box is shown in Figure 6.18(a). Note that in 
this graph, line segments representing the sides of the box are drawn between images 
of pairs of vertices connected in the original box. For instance, because V, and V, are 
connected in the original box, the computer is told to connect the images of V, and V, 
in the rotated box. 


(b) The matrix that yields a rotation of 90° is 
cos 90° —sin 90° 0 0 -I 0 
A=] sin90° — cos 90° O;=]1 0 0}, 
0) 0 1 0 0 1 
and the graph of the rotated box is shown in Figure 6.18(b). 
(c) The matrix that yields a rotation of 120° is 


cos 120° —sin 120° 0 —1/2 -/3/2 0 
A =| sin 120° cos 120° 0] =| /3/2.  -1/2.—s:*OO J, 
z 0 0 1 0 0 1 
Figure 6.18 and the graph of the rotated box is shown in Figure 6.18(c). 


In Example 4, matrices were used to perform rotations about the z-axis. Similarly, you 
can use matrices to rotate figures about the x- or y-axis. All three types of rotations are 
summarized as follows. 


Rotation About the x-Axis Rotation About the y-Axis Rotation About the z-Axis 
1 0 0 cos 0 O sin é cos 9 —sin 0 0 
0 cos @ —sin @ 0 1 0 sin@ cos 6 0) 
0 sin 0 cos 0 —sin 0 0 cosé 0 0 1 


In each case the rotation is oriented counterclockwise relative to a person facing the 
negative direction of the indicated axis, as shown in Figure 6.19. 
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z z 
ok oy 


Rotation about Rotation about Rotation about 
the x-axis the y-axis the z-axis 
Figure 6.19 


EXAMPLE 5| _ Rotation About the x-Axis and y-Axis 


(a) The matrix that yields a rotation of 90° about the x-axis is 


1 oOo oO}; |1 O 0 
FV a=|o 


cos 8 —sin @| = 0 —-ii, 
. : i 1 
Siaiaiion O sind cosé@ 0 0 
Explore this concept further with an and the graph of the rotated box from Example 4 is shown in Figure 6.20(a) below. 
electronic simulation available on 


b) The matrix that yields a rotation of 90° about the y-axis is 
college.hmco.com/pic/arsonELA6e. ©) y » 


cos 8 O sin @ 0 O 1 
A= 0 1 0| = 0 1 Oj, 
—sin 0 0 cos @ -1 0 0 


and the graph of the rotated box from Example 4 is shown in Figure 6.20(b) below. 
(b) 


Figure 6.20 


Rotations about the coordinate axes can be combined to produce any desired view of a 
figure. For instance, Figure 6.21 shows the rotation produced by first rotating the box (from 
Example 4) 90° about the y-axis, then further rotating the box 120° about the z-axis. 


Figure 6.21 
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The use of computer graphics has become common among designers in many fields. By 
simply entering the coordinates that form the outline of an object into a computer, a 
designer can see the object before it is created. As a simple example, the images of the toy 
boat shown in Figure 6.22 were created using only 27 points in space. Once the points have 
been stored in the computer, the boat can be viewed from any perspective. 


p & 
Ls 


Figure 6.22 
Exercises 
The Geometry of Linear Transformations 3. Let T: R* > R’ be a reflection in the line y = x. Find the image 
in the Plane of each vector. 
1. Let T: R?-> R? be a reflection in the x-axis. Find the image of (a) (0, 1) (b) (—1, 3) (c) (a, 0) 
each vector (0.6) (ad) (K-8) 
(a) (3, 5) 6) 2, —1) (c) (a, 0) 4. Let T: R* > R’ be a reflection in the line y = —x. Find the image 
(d) (0, b) (e) (—e, d) (f) (6 8) of each vector. 
2. Let T: R?-> R? be a reflection in the y-axis. Find the image of (a) (—1, 2) (b) (2, 3) (c) (a, 0) 
each vector. (d) (0, b) (e) (e, —d) (ft) (—£#) 
(a) (2, 5) (b)(-4,-1) ©) (a0) 5. Let 7(1, 0) = (0, 1) and 7(0, 1) = (1, 0). 
(d) (0, b) (e) (c, —d) (f) 8) (a) Determine 7(x, y) for any (x, y). 


(b) Give a geometric description of T. 
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6. Let T(1, 0) = (2, 0) and 7(0, 1) = (0, 1). 
(a) Determine T(x, y) for any (x, y). 
(b) Give a geometric description of T. 
In Exercises 7-14, (a) identify the transformation and (b) graphi- 
cally represent the transformation for an arbitrary vector in the 
plane. 
7. T(x, y) = (x, y/2) 
9. T(x, y) = (4x, y) 
11. T(x, y) = (x + 3y, y) 
13. T(x, y) = (x, 2x + y) 


8. T(x, y) = (x/4, y) 
10. T(x, y) = (x, 2y) 
12. T(x, y) = (x + 4y, y) 
14. T(x, y) = (x, 4x + y) 
In Exercises 15-22, find all fixed points of the linear transforma- 
tion. The vector v is a fixed point of T if T(v) = v. 
15. A reflection in the y-axis 
16. A reflection in the x-axis 
17. A reflection in the line y = x 
18. A reflection in the line y = —x 
19. A vertical contraction 
20. A horizontal expansion 
21. A horizontal shear 
22. A vertical shear 
In Exercises 23-28, sketch the image of the unit square with 
vertices at (0,0), (1,0), (1,1), and (0,1) under the specified 
transformation. 
23. T is a reflection in the x-axis. 
24. Tis a reflection in the line y = x. 
25. T is the contraction given by T(x, y) = (x/2, y). 
26. T is the expansion given by T(x, y) = (x, 3y). 
27. T is the shear given by T(x, y) = (x + 2y, y). 
28. T is the shear given by T(x, y) = (x, y + 3x). 
In Exercises 29-34, sketch the image of the rectangle with vertices 
at (0, 0), (0, 2), (1, 2), and (1, 0) under the specified transformation. 
29. T is a reflection in the y-axis. 
30. Tis a reflection in the line y = x. 
31. T is the contraction represented by T(x, y) = (x, y/2). 
32. T is the expansion represented by T(x, y) = (2x, y). 
33. T is the shear represented by T(x, y) = (x + y, y). 
34. T is the shear represented by T(x, y) = (x, y + 2x). 


In Exercises 35-38, sketch each of the images with the given 
vertices under the specified transformations. 


(a) y (b) 


35. T is the shear represented by 7(x, y) = (x + y, y). 

36. T is the shear represented by T(x, y) = (x, x + y). 

37. T is the expansion and contraction represented by 
T(x, y) = (2x, 39). 

38. T is the expansion and contraction represented by 


T(x, y) = (x, 2y). 


39. The linear transformation defined by a diagonal matrix with 
positive main diagonal elements is called a magnification. Find 
the images of (1, 0), (0, 1), and (2, 2) under the linear transfor- 
mation A and graphically interpret your result. 


re 
A= 
0 3 
40. Repeat Exercise 39 for the linear transformation defined by 
0 
a=[5 Sh 
0 3 


In Exercises 41-46, give a geometric description of the linear 
transformation defined by the elementary matrix. 


2 0 1 0 
a. A=| 02. 4=| 
2 1 


0 1 
ve no a 
1 0 0 1 
1 0 =1 0 
A= -A= 
. lo =| sa ie | 


In Exercises 47 and 48, give a geometric description of the linear 
transformation defined by the matrix product. 


of If at ¢ 
ef Jf ole’ 


Computer Graphics 


In Exercises 49-52, find the matrix that will produce the indicated 
rotation. 

50. 60° about the x-axis 

52. 120° about the x-axis 


49. 30° about the z-axis 
51. 60° about the y-axis 


In Exercises 53-56, find the image of the vector (1, 1, 1) for the 
indicated rotation. 


54. 60° about the x-axis 
56. 120° about the x-axis 


53. 30° about the z-axis 
55. 60° about the y-axis 


In Exercises 57-62, determine which single counterclockwise 
rotation about the x-, y-, or z-axis will produce the indicated 
tetrahedron. The original tetrahedron position is illustrated in 
Figure 6.23. 


Figure 6.23 
SIs z 58. z 
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N 


59. 60. 


62. 


> N 


y 


In Exercises 63-66, determine the matrix that will produce the 
indicated pair of rotations. Then find the image of the line segment 
from (0, 0, 0) to (1, 1, 1) under this composition. 

63. 90° about the x-axis followed by 90° about the y-axis 

64. 45° about the y-axis followed by 90° about the z-axis 

65. 30° about the z-axis followed by 60° about the y-axis 

66. 45° about the z-axis followed by 135° about the x-axis 
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Valse Review Exercises 


In Exercises 1—4, find (a) the image of v and (b) the preimage of w 
for the linear transformation. 


1. T: RP? R?, T(v,, v2) = (yy, ¥, + 25), v = (2, —3), 
w = (4, 12) 

2. T: RP? R?, T(v,, v2) = (v, + vo, 22), ¥ = (4, -1), 
w = (8, 4) 

3. T: R? > R>, T(v,, Vo, V3) = (0, ¥; + V2, V2 + V3), 
v = (-3, 2,5), w = (0, 2, 5) 

4. T: RS R?, T(V,, Vo, V3) = (v1 + Vo, Vo + V3 V5)s 
v = (-2,1,2), w = (0, 1,2) 


In Exercises 5—12, determine whether the function is a linear 
transformation. If it is, find its standard matrix A. 


5. T: R? > R*, T(x, %)) = (x, + 2%, —x, — xX) 
6. T: R? > R?, T(x), %)) = (x, + 3, %5) 

7. T: R?->R?, T(x, y) = (x — 2y, 2y — x) 

8. T: R? > R?, T(x, y) = (x + y, yy) 


9. T: R? > R?, T(x,y) =(e +hy+k,h 
(translation in the plane) 


10. T: R? > R?, T(x, y) = (|x, [y]) 
UL. T: RR, T(x), X>,.X3) = (Ky — Xp,Xy — X3,X3 — X,) 
12. T: R? > R°, T(x, y, z) = (z, y, x) 


Oork #0 


’ 


13. Let T be a linear transformation from R? to R? such that 
7(2, 0) = (1, 1) and 7(0, 3) = (3, 3). Find 7(1, 1) and 7(0, 1). 


14. Let T be a linear transformation from R? to R such that 
T(1, 1,1) = 1,711, 1,0) = 2, and 7(1,0,0) = 3. Find 7(0, 1, 1). 


15. Let T be a linear transformation from R? to R? such that 
T(1, 1) = (2, 3) and 7(2, — 1) = (1, 0). Find 7(0, —1). 

16. Let T be a linear transformation from R? to R? such that 
T(1, —1) = (2, —3) and 7(0, 2) = (0, 8). Find 7(2, 4). 

In Exercises 17-20, find the indicated power of A, the standard 

matrix for T. 

17. T: R? > R’, reflection in the xy-plane. Find A?. 

18. T: R> > R?>, projection onto the xy-plane. Find A?. 

19. T: R?->R?, counterclockwise rotation through the angle 0. 
Find A?. 


20. Calculus T: P,;—P,, differential operator. Find A. 


In Exercises 21—28, the linear transformation T: R” — R” is defined 
by 7(v) = Av. For each matrix A, (a) determine the dimensions of 
R” and R”, (b) find the image 7(v) of the given vector v, and (c) 
find the preimage of the given vector w. 

0 1 2 


a. =| 
=2 0 0 


}r-6 1, 1), w = (3,5) 


1 2 —1 
A= ,v = (5, 2, 2), w = (4,2 
» i ; hy (5,2, 2), w = (4,2) 


23. A =[1, 1], v = (2,3), w = (4) 
24. A = [2, -1],v = (1, 2), w = (-1) 


a 
25.A=]0 1 1|,v=(2,1,—-5),w = (6,4, 2) 
0 oOo 1 
2 1 
26. A =| v= 64. = 6.) 
0 1 
4 0 
27.A=]0  5\|,v = (2,2), w = (4, -5, 0) 
1 41 
1 0 
28. A =/0 —1],v = (1,2), w= (2, —-5, 12) 
1 2 


In Exercises 29-32, find a basis for (a) ker(7) and (b) range(7). 
29. T: R*—R?, Tw, x,y,z) = 
(Qw + 4x + 6y + 5z, —w — 2x + 2y, By + 4z) 
30. T: R?— R3, T(x, y, 2) = (x + 2y, y + 2z, z + 2x) 
31. T: 8 R?, T(x, y, 2) = (x t+y,y+zx- 2) 
32. T: R? > R?, T(x, y, z) = (x, y + 2z, 2) 


In Exercises 33-36, the linear transformation T is given by 
T(v) = Av. Find a basis for (a) the kernel of T and (b) the range of 
T, and then find (c) the rank of T and (d) the nullity of T. 


1 2 1 il 
33. A =|=—1 0 34.4 =/0 -1 
1 1 2 1 
2 1 3 1 ld 
35. A=] 1 1 0 36. A =/1 2 1 
0 1 =3 0 1 0 


37. Given T: R®° > R? and nullity(7) = 2, find rank(7). 

38. Given T: P; > P, and nullity(7) = 4, find rank(7). 

39. Given T: P, > R° and rank(T) = 3, find nullity(7). 

40. Given T: M,,— M), and rank(T) = 3, find nullity(7). 

In Exercises 41—48, determine whether the transformation T has an 
inverse. If it does, find A and A~!. 

41. T: R? > R?, T(x, y) = (2x, y) 

42. T: R? > R?, T(x, y) = (0, y) 

43. T: R? > R?, T(x, y) = (xcos 6 — ysin 6, x sin 0 + ycos 6) 
44. T: R?->R?, T(x, y) = (x, —y) 

45. T: R? > R>, T(x, y, z) = (x, y, 0) 

46. T: R? > R°, T(x, y, 2) = (x, —y, 2) 

47. T: RR’, T(x, y,z) = («x + y, y — 2) 

48. T: R? > R?, T(x, y,z) = (x +y + z2) 


In Exercises 49 and 50, find the standard matrices for T = T, ° T; 
and T’ = T, °T,. 
49. T,: R?R?, T,(x, y) = (x + y, y) 
Ty: R? > R*, T,(x, y, z) = (0, y) 
50. T;: RR’, T(x) = (x, 3x) 
T,: R? SR, T(x, y) = (y + 2x) 
51. Use the standard matrix for counterclockwise rotation in R? 


to rotate the triangle with vertices (3,5), (5,3), and (3, 0) 
counterclockwise 90° about the origin. Graph the triangles. 


52. Rotate the triangle in Exercise 51 counterclockwise 90° about 
the point (5, 3). Graph the triangles. 


In Exercises 53-56, determine whether the linear transformation 
represented by the matrix A is (a) one-to-one, (b) onto, and (c) 
invertible. 


2 O 1 1 1 

33.4 =| 4. =| 
0 3 oO 1 1 
: 2 4 0 7 
55.4 =|) | 56.A=15 5 1 
0 oO 2 


In Exercises 57 and 58, find T(v) by using (a) the standard matrix 
and (b) the matrix relative to B and B’. 


57. T: R? > R3, T(x, y) = (-x,y,x + y),v = (0, 1), 

B = {(1, 1), 1, —1)}, B’ = {(0, 1, 0), (0, 0, 1), (1, 0, 0)} 
58. T: R? > R2, T(x, y) = (2y, 0), v = (-1, 3), 

B = {(2, 1), (-1, 0)}, B’ = {(-1, 0), (2, 2)} 
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In Exercises 59 and 60, find the matrix A’ for T relative to the basis 
B’ and show that A’ is similar to A, the standard matrix for T. 


59. T: R* > R*, T(x, y) = (x — 3y,y — x), B’ = {(1, -1), (1, I} 
60. T: R? > R°, T(x, y, z) = (« + 3y, 3x + y, — 22), 
B’ = {(1, 1,0), (1, —1, 0), (0, 0, 1)} 


61. Let T: R?—>R?> be represented by 7T(v) = proj,v, where u = 
(0, 1,2). 
(a) Find A, the standard matrix for T. 
(b) Let S be the linear transformation represented by J — A. 
Show that S is of the form S(v) = PLOjw,V + Projy,V, 
where w, and w, are fixed vectors in R°. : 
(c) Show that the kernel of T is equal to the range of S. 
62. Let T:R?—R? be represented by T(v) = proj,v, where 
u = (4, 3). 
(a) Find A, the standard matrix for T, and show that A? = A. 
(b) Show that (J — A)? =I — A. 
(c) Find Av and (J — A)v for v = (5, 0). 
(d) Sketch the graph of u, v, Av, and (J — A)v. 
63. Let S and T be linear transformations from V into W. Show 


that S + T and kT are both linear transformations, where 
(S + T)(v) = S(v) + T(v) and (kT)(v) = kT(v). 
64. Suppose A and B are similar matrices and A is invertible. 
(a) Prove that B is invertible. 


(b) Prove that A~! and B~! are similar. 


In Exercises 65 and 66, the sum S$ + TJ of two linear transfor- 
mations S: VW and T:V—W is defined as (S + T)(v) = 
S(v) + T(v). 
65. Prove that rank(S + 7) < rank(S) + rank(7). 
66. Give an example for each. 

(a) Rank(S + T) = rank(S) + rank(T) 

(b) Rank(S + 7) < rank(S) + rank(7) 
67. Let T: P;—>R such that Tay + ayx + ayx? + a,x) = 

dy + Ay + dy + Az. 


(a) Prove that T is linear. 

(b) Find the rank and nullity of T. 

(c) Find a basis for the kernel of T. 

68. Let T: VU and S$: U— W be linear transformations. 

(a) Prove that if S and T are both one-to-one, then so is 
SoT. 

(b) Prove that the kernel of T is contained in the kernel of 
SoT,. 

(c) Prove that if S ° T is onto, then so is S. 
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69. Let V be an inner product space. For a fixed nonzero vector Vv, in 
V, let T; VR be the linear transformation T(v) = (v, Vo). 
Find the kernel, range, rank, and nullity of T. 


70. Calculus Let B= {1,x,sinx,cosx} be a basis for a 
subspace W of the space of continuous functions, and let D, be 
the differential operator on W. Find the matrix for D, 
relative to the basis B. Find the range and kernel of D... 


71. Writing Under what conditions are the spaces M,,,,, and M 


mn Pd 
isomorphic? Describe an isomorphism T in this case. 


72. Calculus Let T: P; > P, be represented by 
T(p) = p(x) + p(x). Find the rank and nullity of T. 


The Geometry of Linear Transformations 
in the Plane 


In Exercises 73-78, (a) identify the transformation and (b) graphi- 
cally represent the transformation for an arbitrary vector in the plane. 


73. T(x, y) = (x, 2y) 74, Tx, y) = (& + y,y) 

75. T(x, y) = (x, y + 3x) 76. T(x, y) = (5x, y) 

77. Tix, y) = @& + 2y,y) 78. T(x, y) = (x, x + 2y) 

In Exercises 79-82, sketch the image of the triangle with vertices 
(0, 0), (1, 0), and (0, 1) under the given transformation. 

79. T is a reflection in the x-axis. 

80. T is the expansion represented by T(x, y) = (2x, y). 

81. T is the shear represented by T(x, y) = (x + 3y, y). 

82. T is the shear represented by 7(x, y) = (x, y + 2x). 


In Exercises 83 and 84, give a geometric description of the linear 
transformation defined by the matrix product. 


83. li | = h 4 b 4 

1 0 0 1ill 0 

84 B = | F | 

“lo 2) Lo 2/13 1 
Computer Graphics 


In Exercises 85-88, find the matrix that will produce the indicated 
rotation and then find the image of the vector (1, — 1, 1). 


86. 90° about the x-axis 
88. 30° about the y-axis 


85. 45° about the z-axis 
87. 60° about the x-axis 


In Exercises 89-92, determine the matrix that will produce the 
indicated pair of rotations. 


89. 60° about the x-axis followed by 30° about the z-axis 


90. 120° about the y-axis followed by 45° about the z-axis 

91. 30° about the y-axis followed by 45° about the z-axis 

92. 60° about the x-axis followed by 60° about the z-axis 

In Exercises 93-96, find the image of the unit cube with vertices 
(0, 0, 0), (1, 0,0), (1, 1,0), (0, 1,0), (0,0, 1), (1,0, 1), (1,1, 1), 
and (0, 1, 1) when it is rotated by the given angle. 

94. 90° about the x-axis 

96. 120° about the z-axis 


93. 45° about the z-axis 
95. 30° about the x-axis 
True or False? In Exercises 97-100, determine whether each state- 
ment is true or false. If a statement is true, give a reason or cite an 
appropriate statement from the text. If a statement is false, provide 


an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


97. (a) Linear transformations called reflections that map a point 
in the xy-plane to its mirror image across the line y = x 


| in M, ». 
(b) The linear transformations called horizontal expansions or 


0 
in Mj 5. 


are defined by the standard matrix F 


k 
contractions are defined by the matrix 0 


1 0 0 
(c) The matrix | 0 1/2 —/3/2 | would rotate a point 
0 3/2 1/2 


60° about the x-axis. 


98. (a) Linear transformations called reflections that map a point 
in the xy-plane to its mirror image across the x-axis are 


defined by the matrix b | in M, ». 


(b) The linear transformations called vertical expansions or 


: _ fl 0}. 
contractions are defined by the matrix | 0 | in M, ». 


J3/2 0 1/2 
(c) The matrix 0 1 0 | would rotate a 
-1/2 0 /3/2 
point 30° about the y-axis. 


99. (a) In calculus, any linear function is also a linear transforma- 
tion from R? to R?. 
(b) A linear transformation is said to be onto if and only if for 
all u and v in V, T(u) = 7(v) implies u = v. 


(c) Because of the computational advantages, it is best to choose 
a basis for V such that the transformation matrix is diagonal. 
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100. (a) For polynomials, the differential operator D, is a linear (c) The standard matrix A of the composition of two linear 
transformation from P, to P,_,. transformations T(v) = T>(T,(v)) is the product of the 
(b) The set of all vectors v in V that satisfy T(v) = v is called standard matrix for T, and the standard matrix for T,. 
the kernel of T. 
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1 Reflections in the Plane (I) 


Let € be the line ax + by = 0 in the plane. The linear transformation L: R? > R? that 
sends a point (x, y) to its mirror image in ¢ is called the reflection in £. (See Figure 
6.24.) 

The goal of these two projects is to find the matrix for this reflection relative to the 
standard basis. The first project is based on transition matrices, and the second 
project uses projections. 

1. Find the standard matrix for L for the line x = 0. 

2. Find the standard matrix for L for the line y = 0. 

3. Find the standard matrix for L for the line x — y = 0. 

4. Consider the line € represented by x — 2y = 0. Find a vector v parallel to 
€ and another vector w orthogonal to €. Determine the matrix A for the 
reflection in € relative to the ordered basis {v, w}. Finally, use the appropri- 
ate transition matrix to find the matrix for the reflection relative to the 
standard basis. Use this matrix to find L(2, 1), L(—1, 2), and L(5, 0). 

5. Consider the general line ax + by = 0. Let v be a vector parallel to €, and 
let w be a vector orthogonal to €. Determine the matrix A for the reflection 
in £ relative to the ordered basis {v, w}. Finally, use the appropriate transi- 
tion matrix to find the matrix for L relative to the standard basis. 

6. Find the standard matrix for the reflection in the line 3x + 4y = 0. Use this 
matrix to find the images of the points (3, 4), (—4, 3), and (0, 5). 


Figure 6.24 
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2 Reflections in the Plane (II) 


In this second project, you will use projections to determine the standard matrix for 
the reflection L in the line ax + by = 0. (See Figure 6.25.) Recall that the projection 
of the vector u onto the vector v is represented by 


u 
proj,u = 

Vv 

il 


Ds 
3h 


Vv 
Vi 


Find the standard matrix for the projection onto the y-axis. That is, find the 
standard matrix for proj,u if v = (0, 1). 

Find the standard matrix for the projection onto the x-axis. 

Consider the line € represented by x — 2y = 0. Find a vector v parallel to ¢ 
and another vector w orthogonal to €. Determine the matrix A for the projec- 
tion onto f relative to the ordered basis {v, w}. Finally, use the appropriate 
transition matrix to find the matrix for the projection relative to the standard 
basis. Use this matrix to find proj,u for the cases u = (2, 1), u = (—1, 2), 
and u = (5, 0). 


. Consider the general line ax + by = 0. Let v be a vector parallel to €, and 


let w be a vector orthogonal to €. Determine the matrix A for the projection 
onto € relative to the ordered basis {v, w}. Finally, use the appropriate 
transition matrix to find the matrix for the projection relative to the standard 
basis. 


. Use Figure 6.26 to show that 


projyu = 3(u + L(u)), 


where L is the reflection in the line €. Solve this equation for L and compare 
your answer with the formula from the first project. 


y 


L(u) 


projyu v 


Figure 6.25 Figure 6.26 
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Eigenvalues and 


EKigenvectors 


CHAPTER OBJECTIVES 


Find the eigenvalues and corresponding eigenvectors of a linear transformation, as well as the 
characteristic equation and the eigenvalues and corresponding eigenvectors of a matrix A. 


Demonstrate the Cayley-Hamilton Theorem for a matrix A. 

Find the eigenvalues of both an idempotent matrix and a nilpotent matrix. 

Determine whether a matrix is triangular, diagonalizable, symmetric, and/or orthogonal. 
Find (if possible) a nonsingular matrix P for a matrix A such that P~'AP is diagonal. 


Find a basis B (if possible) for the domain of a linear transformation T such that the matrix of 
T relative to B is diagonal. 


Find the eigenvalues of a symmetric matrix and determine the dimension of the 
corresponding eigenspace. 


Find an orthogonal matrix P that diagonalizes A. 


Find and use an age transition matrix and an age distribution vector to form a population 
model and find a stable age distribution for the population. 


Solve a system of first-order linear differential equations. 
Find a matrix of the quadratic form associated with a quadratic equation. 


Use the Principal Axes Theorem to perform a rotation of axes and eliminate the xy-, xz-, and 
yz-terms, and find the equation of the rotated quadratic surface. 


7.1 | Eigenvalues and Eigenvectors 


This section presents one of the most important problems in linear algebra, the eigenvalue 
problem. Its central question can be stated as follows. If A is ann x n matrix, do nonzero 
vectors x in R” exist such that Ax is a scalar multiple of x? The scalar, denoted by the Greek 


le 


tter lambda (A), is called an eigenvalue of the matrix A, and the nonzero vector x is called 


an eigenvector of A corresponding to A. The terms eigenvalue and eigenvector are derived 
from the German word Eigenwert, meaning “proper value.” So, you have 


421 


422 Chapter 7 Eigenvalues and Eigenvectors 


Eigenvalue 


AX = AX. 


Eigenvector 


Although you looked at the eigenvalue problem briefly in Section 3.4, the approach in 
this chapter will not depend on that material. 

Eigenvalues and eigenvectors have many important applications, some of which are dis- 
cussed in Section 7.4. For now you will consider a geometric interpretation of the problem 
in R?. If A is an eigenvalue of a matrix A and x is an eigenvector of A corresponding to A, 
then multiplication of x by the matrix A produces a vector Ax that is parallel to x, as shown 
in Figure 7.1. 


Ax = Ax,A>0 Ax =Ax,1<0 


Figure 7.1 


Definitions of Eigenvalue 
and Eigenvector 


Only real eigenvalues are presented in this chapter. 
REMARK: Note that an eigenvector cannot be zero. Allowing x to be the zero vector 
would render the definition meaningless, because AO = AO is true for all real values of A. 


An eigenvalue of X = 0, however, is possible. (See Example 2.) 


A matrix can have more than one eigenvalue, as demonstrated in Examples | and 2. 


EXAMPLE 1 
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Verifying Eigenvalues and Eigenvectors 


SOLUTION 


EXAMPLE 2 


For the matrix 


verify that x, = (1, 0) is an eigenvector of A corresponding to the eigenvalue A, = 2, and 
that x, = (0, 1) is an eigenvector of A corresponding to the eigenvalue A, = —1. 


Multiplying x, by A produces 


> -illal 


= 


Eigenvalue Eigenvector 


So, x, = (1, 0) is an eigenvector of A corresponding to the eigenvalue A, = 2. Similarly, 
multiplying x, by A produces 


m2 AE 
(4 
| 


So, x, = (0, 1) is an eigenvector of A corresponding to the eigenvalue A, = —1. 


Verifying Eigenvalues and Eigenvectors 


For the matrix 


1 -=2 1 
A= {0 0 0}, 
0 1 1 


verify that 
x, =(-3,-1,1) and x, =(1,0,0) 


are eigenvectors of A and find their corresponding eigenvalues. 
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SOLUTION 


Discovery 


In Example 2, 4, = 11s an 
eigenvalue of the matrix A. 
Calculate the determinant of the 
matrix A — XI, where | is the 
3 x 3 Identity matrix. Repeat 
this experiment for the other 
eigenvalue, A, = 0. In general, 
if X is an eigenvalue of the 
matrix A, what Is the value of 
|A — All? 


THEOREM 7.1 
Eigenvectors of A Form a 
Subspace 


Multiplying x, by A produces 


1-2 1)[-3] fo -3 
Ax,=|0 0 O|/-1}=/0]=0/-1]. 
o 1 1} 1] Lo 1 


So, x, = (—3, —1, 1) is an eigenvector of A corresponding to the eigenvalue A, = 0. 
Similarly, multiplying x, by A produces 


j= 2 1}]1 1 1 
Ax, =| 0 0 0]/O0} =|0} = 1/0}. 
0 1 1}L0 0 0 


So, x, = (1, 0, 0) is an eigenvector of A corresponding to the eigenvalue A, = 1. 


Eigenspaces 


Although Examples | and 2 list only one eigenvector for each eigenvalue, each of the four 
eigenvalues in Examples | and 2 has an infinite number of eigenvectors. For instance, in 
Example | the vectors (2, 0) and (—3, 0) are eigenvectors of A corresponding to the eigen- 
value 2. In fact, if A is an m x n matrix with an eigenvalue A and a corresponding 
eigenvector x, then every nonzero scalar multiple of x is also an eigenvector of A. This may 
be seen by letting c be a nonzero scalar, which then produces 


A(cx) = c(Ax) = c(Ax) = A(cx). 


It is also true that if x, and x, are eigenvectors corresponding to the same eigenvalue A, then 
their sum is also an eigenvector corresponding to A, because 


A(x, + x,) = Ax, + Ax, = Ax, + Ax, = A(x, + x,). 


In other words, the set of all eigenvectors of a given eigenvalue A, together with the zero 
vector, is a subspace of R”. This special subspace of R” is called the eigenspace of A. 


If A is ann X n matrix with an eigenvalue A, then the set of all eigenvectors of A, together 
with the zero vector 


{0} U {x: x is an eigenvector of A}, 


is a subspace of R”. This subspace is called the eigenspace of 2. 


Determining the eigenvalues and corresponding eigenspaces of a matrix can be difficult. 
Occasionally, however, you can find eigenvalues and eigenspaces by simple inspection, as 
demonstrated in Example 3. 
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EXAMPLE 3| AnExample of Eigenspaces in the Plane 


Find the eigenvalues and corresponding eigenspaces of 


alo al 


SOLUTION Geometrically, multiplying a vector (x, y) in R? by the matrix A corresponds to a reflection 
in the y-axis. That is, if v = (x, y), then 


(-x, y) y]| Gy) ay) [- 1 q ‘ i ‘ 
- ao == -@------- 2 AV = = : 
0 li Ly y 


Figure 7.2 illustrates that the only vectors reflected onto scalar multiples of themselves are 
those lying on either the x-axis or the y-axis. 


For a vector on the x-axis For a vector on the y-axis 


wo bo allel Pole tol bo Le bd 


x 


A set ecis-vectors Eigenvalue is}, = —1. Eigenvalue is A, = 1. 


in the y-axis. 


So, the eigenvectors corresponding to A, = —1 are the nonzero vectors on the x-axis, and 
Figure 7.2 the eigenvectors corresponding to A, = | are the nonzero vectors on the y-axis. This 
implies that the eigenspace corresponding to A, = — | is the x-axis, and that the eigenspace 


corresponding to A, = | is the y-axis. 


Finding Eigenvalues and Eigenvectors 


The geometric solution in Example 3 is not typical of the general eigenvalue problem. A 
general approach will now be described. 

To find the eigenvalues and eigenvectors of an n x n matrix A, let J be the n xn 
identity matrix. Writing the equation Ax = Ax in the form AJx = Ax then produces 


(AI — A)x = 0. 


This homogeneous system of equations has nonzero solutions if and only if the coefficient 
matrix (AJ — A) is not invertible—that is, if and only if the determinant of (AJ — A) is zero. 
This is formally stated in the next theorem. 
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THEOREM 7.2 


Eigenvalues and 
Eigenvectors of a Matrix 


EXAMPLE 4 


Let A be ann X n matrix. 
1. An eigenvalue of A is a scalar such that 
det(AJ — A) = 0. 
2. The eigenvectors of A corresponding to A are the nonzero solutions of 


(AI — A)x = 0. 


The equation det(AJ — A) = 0 is called the characteristic equation of A. Moreover, 
when expanded to polynomial form, the polynomial 


JAI— A] =A" + c,_,A7 1 +--+ +e,A +c 


is called the characteristic polynomial of A. This definition tells you that the eigenvalues 
of ann x n matrix A correspond to the roots of the characteristic polynomial of A. Because 
the characteristic polynomial of A is of degree n, A can have at most n distinct eigenvalues. 


REMARK: The Fundamental Theorem of Algebra states that an nth-degree polynomial has 
precisely n roots. These n roots, however, include both repeated and complex roots. In this 
chapter you will be concerned only with the real roots of characteristic polynomials—that 
is, real eigenvalues. 


Finding Eigenvalues and Eigenvectors 


SOLUTION 


Find the eigenvalues and corresponding eigenvectors of 


F = “| 
A= 4 
1 -=5 
The characteristic polynomial of A is 
=D 12 
|AI— Al = | | 


=1 A+S 

= (A — 2)(A + 5) — (—12) 

= + 3A-— 10+ 12 

=)?+3A+2 

=(A+ I + 2). 
So, the characteristic equation is (A + 1)(A + 2) = 0, which gives A, = —1 and A, = —2 
as the eigenvalues of A. To find the corresponding eigenvectors, use Gauss-Jordan elimina- 


tion to solve the homogeneous linear system represented by (AJ — A)x = 0 twice: first for 
A =X, = —1, and then for A = A, = —2. For A, = —1, the coefficient matrix is 


coma ella al 


Finding Eigenvalues 
and Eigenvectors 
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which row reduces to 


Doh 


showing that x, — 4x, = 0. Letting x, = t, you can conclude that every eigenvector of A, 
is of the form 


EYL 


For A, = —2, you have 


carma=[PT is IL 4 


—[) 3h 


Letting x, = ¢, you can conclude that every eigenvector of 1, is of the form 


[=P b 8 


Try checking Ax = A;x for the eigenvalues and eigenvectors in this example. 


The homogeneous systems that arise when you are finding eigenvectors will always 
row reduce to a matrix having at least one row of zeros, because the systems must have 
nontrivial solutions. The steps used to find the eigenvalues and corresponding eigenvectors 
of a matrix are summarized as follows. 


Finding the eigenvalues of an n x n matrix can be difficult because it involves the 
factorization of an nth-degree polynomial. Once an eigenvalue has been found, however, 
finding the corresponding eigenvectors is a straightforward application of Gauss-Jordan 
reduction. 
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EXAMPLE 5 


Finding Eigenvalues and Eigenvectors 


SOLUTION 


Find the eigenvalues and corresponding eigenvectors of 


2 1 0 
A= {0 2 0}. 
0 0 2 


What is the dimension of the eigenspace of each eigenvalue? 


The characteristic polynomial of A is 


A-2 -1 0 
|AI— A| = 0 A-2 0} = (a - 2)3. 
0 0 A-2 


So, the characteristic equation is (A — 2)? = 0. 
So, the only eigenvalue is A = 2. To find the eigenvectors of A = 2, solve the homoge- 
neous linear system represented by (27 — A)x = 0. 


0 =] 0 
2I-A=]|0 0 0 
0 0 0 


This implies that x, = 0. Using the parameters s = x, and ¢ = x3, you can find that the 
eigenvectors of A = 2 are of the form 


XG Ss 1 0 
xX = ]x,}=|0} =s}/0} +40], sand ¢ not both zero. 
X3 t 0 1 


Because A = 2 has two linearly independent eigenvectors, the dimension of its eigenspace 
is 2. 


If an eigenvalue A, occurs as a multiple root (k times) of the characteristic polynomial, 
then A, has multiplicity k. This implies that (A — A,) is a factor of the characteristic 
polynomial and (A — A,)**! is not a factor of the characteristic polynomial. For instance, 
in Example 5 the eigenvalue A = 2 has a multiplicity of 3. 

Also note that in Example 5 the dimension of the eigenspace of A = 2 is 2. In general, 
the multiplicity of an eigenvalue is greater than or equal to the dimension of its eigenspace. 


EXAMPLE 6 
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Finding Eigenvalues and Eigenvectors 


SOLUTION 


Find the eigenvalues of 


1 0 0 0 

0 1 > =10 
A= 

1 0 2 0 

1 0 0 3 


and find a basis for each of the corresponding eigenspaces. 


The characteristic polynomial of A is 


= 0 0 0 
GO. AT =5 10 
|r — Al = =f 0 2=3 0 
=1 0 G {=3 


= (A — 1)°(A — 2)(A — 3). 


So, the characteristic equation is (A — 1)?(A — 2)(A — 3) = 0 and the eigenvalues are 
A, = 1,A, = 2, and A, = 3. (Note that A, = 1 has a multiplicity of 2.) 
You can find a basis for the eigenspace of A, = | as follows. 


0 0 0 0 1 0 0 2 
0 0 —-5 10 0 0 | =2 
()I-A= = 
=] 0 -1 0 0 0 0 0 
=] 0 O! 2 0 0 0 0 
Letting s = x, and t = x, produces 
xy Os = 2t 0 =2 
oa s + Ot 1 0 
x= = =s + t . 
X3 Os + 2t 0 2 
X4 Os ft 0 1 
A basis for the eigenspace corresponding to A, = | is 
B, = {(0, 1, 0, 0), (-2, 0, 2; 1)}. Basis for A, = 1 
For A, = 2 and 1, = 3, follow the same pattern to obtain the eigenspace bases 
B, = {(0, 5, 1, 0)} Basis for A, = 2 
B, = {(0, —5, 0, 1)}. Basis for A, = 3 


Finding eigenvalues and eigenvectors of matrices of order n = 4 can be tedious. 
Moreover, the procedure followed in Example 6 is generally inefficient when used on a 
computer, because finding roots on a computer is both time consuming and subject to 
roundoff error. Consequently, numerical methods of approximating the eigenvalues of large 
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matrices are required. These numerical methods can be found in texts on advanced linear 
algebra and numerical analysis. 


Technolo gy Many computer software programs and graphing utilities have built-in programs to approximate the 
Note eigenvalues and eigenvectors of ann x n matrix. If you enter the matrix A from Example 6, you 
should obtain the four eigenvalues 


5 eae 


Your computer software program or graphing utility should also be able to produce a matrix in 
which the columns are the corresponding eigenvectors, which are sometimes scalar multiples 


of those you would obtain by hand calculations. Keystrokes and programming syntax for these 
utilities/programs applicable to Example 6 are provided in the Online Technology Guide, available 
at college.hmco.com/pic/larsonELA6e. 


There are a few types of matrices for which eigenvalues are easy to find. The next 
theorem states that the eigenvalues of ann x n triangular matrix are the entries on the main 
diagonal. Its proof follows from the fact that the determinant of a triangular matrix is the 
product of its diagonal elements. 


THEOREM 7.3 : : : ee: é : : 
‘ If A is an n Xn triangular matrix, then its eigenvalues are the entries on its main 
Eigenvalues of diagonal. 


Triangular Matrices 


EXAMPLE 7|_ Finding Eigenvalues of Diagonal and Triangular Matrices 


Find the eigenvalues of each matrix. 


-l 0 0 0 0 

2 0 0 0 2 0 0 0O 

(a) A=] -1 1 0 (b) A= 0 0 0 0 0O 
bs) 3 =3 0 0 0-4 0 

0 0 0 0 3 


SOLUTION (a) Without using Theorem 7.3, you can find that 


A-2 0 0 
jar — Al = 1 a-l 0 
-5 -3 At+3 


(A — 2)(A — 1)(A + 3). 


EXAMPLE 8 
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So, the eigenvalues are A, = 2,A, = 1, and A; = —3, which are simply the main 
diagonal entries of A. 


(b) In this case, use Theorem 7.3 to conclude that the eigenvalues are the main diagonal 
entries A, = —1,A, = 2,A, =0,A,4 4, and A, = 3. 


Eigenvalues and Eigenvectors of Linear Transformations 


This section began with definitions of eigenvalues and eigenvectors in terms of matrices. 
They can also be defined in terms of linear transformations. A number A is called an 
eigenvalue of a linear transformation T: V— V if there is a nonzero vector x such that 
T(x) = Ax. The vector x is called an eigenvector of T corresponding to A, and the set of all 
eigenvectors of A (with the zero vector) is called the eigenspace of A. 

Consider the linear transformation T: R* > R*, whose matrix relative to the standard 
basis is 


| 3 0 Standard basis: 
A=|3 1 O}. B = {(1, 0,0), (0, 1, 0), (0, 0, 1} 
o oO = 


In Example 5 of Section 6.4, you found that the matrix of T relative to the basis B’ is the 
diagonal matrix 


+ 0 0 Nonstandard basis: 
A‘=10 —2 0}. B’ = {(1, 1, 0), (1, -1, 0), (0, 0, D} 
¢ @ = 


The question now is: “For a given transformation T, can you find a basis B’ whose 
corresponding matrix is diagonal?” The next example gives an indication of the answer. 


Finding Eigenvalues and Eigenspaces 


SOLUTION 


Find the eigenvalues and corresponding eigenspaces of 


1 3 0 
A=]3 1 0}. 
0 QO -2 
Because 
A-1 —3 0 
|Al A| = 3 A-I1 0 
0 0 A+2 


= (A + 2)[(A — 1)? - 9] 
= (A + 2)(A2 — 2A — 8) = (A + 2)°(A — 4), 
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the eigenvalues of A are A, = 4 and A, = —2. The eigenspaces for these two eigenvalues 
are as follows. 


B= {(1, 1, 0)} Basis for A, = 4 
B, a {(1, =I, 0), (0, 0, 1)} Basis for A, = —2 


Example 8 illustrates two important and perhaps surprising results. 


1. Let T: R? — R? be the linear transformation whose standard matrix is A, and let B’ be the 
basis of R? made up of the three linearly independent eigenvectors found in Example 8. 
Then A’, the matrix of T relative to the basis B’, is diagonal. 


4 0 0 
A’=10 c y) 0 Nonstandard basis: 
0 ocd B’ = {(1, 1, 0), (1, 1, 0), (0, 0, 1D} 


Eigenvalues of A Eigenvectors of A 


2. The main diagonal entries of the matrix A’ are the eigenvalues of A. 


The next section formalizes these two results and also characterizes linear transforma- 
tions that can be represented by diagonal matrices. 


Sante) Ae Exercises 


In Exercises 1-8, verify that A; is an eigenvalue of A and that x; is 0 1 0 
a corresponding eigenvector. 7.A=|0 0 1}, A, =Lx,=(L1,0 
.a={! "| A, = 1.x, = (1,0) 1 0 0 
: 0 -1? A =-1,x,=(,1) 4-1 3] A,=4x, =(1,0,0) 
2.-[4 e] A,=-Lx,=(1,1) 8A=|0 2 11, A, =2,x,=(1,2,0) 
; 2 -3) aA, =2,x, = (5,2) 0 O 3) A,=3,x,=(-2,1,1) 
3A= E i}: Ay = Oe =O 1) 9. Use A, X;, and x, from Exercise 3 to show that 
1 af Hes, =) 
? (a) A(cx,) = O(cx,) for any real number c. 
ae le 4 A, = 2,x, = (1, 1) (b) A(cx,) = 2(cx,) for any real number c. 
| | Ay = —3,.% = (-4,1) 10. Use A, A;, and x; from Exercise 5 to show that 
2 3 I A, = 2,x, = (1,0, 0) (a) A(cx,) = 2(cx,) for any real number c. 
5.A=/]0 -1 2}, A,=—-1,x, = (1, -1,0) (b) A(cx,) = —(cx,) for any real number c. 
0 0 3] A, = 3,x, = (5, 1, 2) (c) A(cx;) = 3(cx,) for any real number c. 
—2 2 -3) A, =5,x, =(1,2,—-1) 
6A=| 2 1 -6], A,=—3,x, =(-2,1,0) 
-1 -2 0 A; = —3, x; = (3,0, 1) 


In Exercises 11-14, determine whether x is an eigenvector of A. 


11. A= ; ‘| 


2 4 
(a) x = (1, 2) 
(b) x = (2, 1) 
(c) x = (1, —2) 
(d) x = (-1,0) 
=f =1 1 
13. A=|-2 QO —-2 
3° -=3 1 
1 0 5 
14.A=|0 —2 4 
1 —2 9 


12, A= ie "1 

5 2 
(a) x = (4, 4) 
(b) x = (-8, 4) 
(c) x = (—4, 8) 
(d) x = (5, —3) 


(a) x = (2, —4, 6) 

(b) x = (2, 0, 6) 

(c) x = (2, 2, 0) 

(d) x = (-1,0, 1) 

(a) x = (1, 1, 0) 

(b) x = (—5, 2, 1) 

(c) x = (0, 0, 0) 

(d) x = (26 —3,-26 + 6,3) 


In Exercises 15-28, find (a) the characteristic equation and (b) the 
eigenvalues (and corresponding eigenvectors) of the matrix. 


15. | ° “ 
= | 


i 2 
Tap ] 
5 =1 
2 0 1 
19. | 0 3 4 
0 0 1 
2 —2 3 
21. | 0 3 2 
0 -I 2 
1 2. -=2 
23. | —2 y. =2 
=6 6° —3 
Q: =3 > 
25. | —4 4 -10 
0 0 4 
2 0 0 0 
0 2 0) 0 
sii 0 0 3 0 
0 0 4 0 


1 -4 
|) | 


1 
4 
18. | { 
2 
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42) In Exercises 29-40, use a graphing utility with matrix capabilities 


iM 
i 


or a computer software program to find the eigenvalues of the 


matrix. 
29. I | 30. i ;| 
2 3 3-6 
7 2 - 2 
u[ 7 2 n[o 7 
2 3 3-1 
0-7 5 t 0 5 
33. }-4+ -2 —-} 34./-2 § jj 
0 oOo 4 0 0 3 
2 4 2 1 2-1 
35./1 O 1 36. | 1 1 
1-4 5 1-1 2 
1 o-1 1 1-3 3 
0 1 1 ov -l 4 -3 - 
37. IM 38, = 
<2 0 % =) —2 oO 1 
0 2 2 1 0 0 0 
1 1 2 3 1 1 0 0 
2 2 4 ¥ 4 4 
39. i IM 40. 9% 
3 3 6 9 0 o 1 1 
4 4 8 12 0 0 2 2 


In Exercises 41-48, demonstrate the Cayley-Hamilton Theorem 
for the given matrix. The Cayley-Hamilton Theorem states that a 
matrix satisfies its characteristic equation. For example, the charac- 
teristic equation of 


ae |; “s 

2 5 
is A> — 6A + 11 = 0, and by the theorem you have 
A?— 6A + 111, = 0. 


a1. | : | 42. b ra 
a) 1 5 
43. F = 44. | : | 
1 5 —% 4 
G 8 <4 > t¢ a 
4./-1 3 1 46. | 2 0 
0. G4 5 5 6 
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1 0 -4 = 1 0 
47. | 0 > 1 48. | -1 3 2 
2 0 1 0 4 3 


49. Perform the computational checks listed below on the eigen- 
values found in Exercises 15-27 odd. 


(a) The sum of the n eigenvalues equals the sum of the 
diagonal entries of the matrix. (This sum is called the 
trace of A.) 

(b) The product of the n eigenvalues equals |A|. 


(If A is an eigenvalue of multiplicity k, remember to enter it k 
times in the sum or product of these checks.) 


50. Perform the computational checks listed below on the eigen- 
values found in Exercises 16—28 even. 


(a) The sum of the n eigenvalues equals the sum of the 
diagonal entries of the matrix. (This sum is called the 
trace of A.) 

(b) The product of the n eigenvalues equals |A|. 


(If A is an eigenvalue of multiplicity k, remember to enter it k 
times in the sum or product of these checks.) 


51. Show that if A is an n x n matrix whose ith row is identical to 
the ith row of J, then 1 is an eigenvalue of A. 

52. Prove that A = 0 is an eigenvalue of A if and only if A is 
singular. 


53. Writing For an invertible matrix A, prove that A and A~! have 
the same eigenvectors. How are the eigenvalues of A related to 
the eigenvalues of A~!? 


54. Writing Prove that A and A” have the same eigenvalues. Are 
the eigenspaces the same? 


55. Prove that the constant term of the characteristic polynomial 
is +A]. 

56. Let T: R’ > R? be represented by 7(v) = proj,v, where u is a 
fixed vector in R*. Show that the eigenvalues of A (the standard 
matrix of 7) are 0 and 1. 


57. Guided Proof Prove that a triangular matrix is nonsingular if 
and only if its eigenvalues are real and nonzero. 


Getting Started: Because this is an “if and only if” statement, 
you must prove that the statement is true in both directions. 
Review Theorems 3.2 and 3.7. 


(i) To prove the statement in one direction, assume that the 
triangular matrix A is nonsingular. Use your knowledge 
of nonsingular and triangular matrices and determinants 
to conclude that the entries on the main diagonal of A 
are nonzero. 


ii) Because A is triangular, you can use Theorem 7.3 and 
8 y 
part (i) to conclude that the eigenvalues are real and 
nonzero. 


(iii) To prove the statement in the other direction, assume 
that the eigenvalues of the triangular matrix A are real 
and nonzero. Repeat parts (i) and (11) in reverse order to 
prove that A is nonsingular. 

58. Guided Proof Prove that if A = O, then 0 is the only 
eigenvalue of A. 

Getting Started: You need to show that if there exists a 
nonzero vector x and a real number A such that Ax = Ax, then 
if A* = O, A must be zero. 

(i) Because A? = A - A, you can write Ax as A(Ax). 

(ii) Use the fact that Ax = Ax and the properties of matrix 

multiplication to conclude that A?x = A?x. 


(iii) Because A? is a zero matrix, you can conclude that A 
must be zero. 


59. If the eigenvalues of 


a-[p al 


are A, = 0 and A, = 1, what are the possible values of a 
and d? 


60. Show that 


il 

A= 

—1 0 

has no real eigenvalues. 


True or False? In Exercises 61 and 62, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, 
provide an example that shows the statement is not true in all cases 
or cite an appropriate statement from the text. 


61. (a) The scalar A is an eigenvalue of ann x n matrix A if there 
exists a vector x such that Ax = Ax. 


(b) IfA is ann x n matrix with eigenvalue A and corresponding 
eigenvector x, then every nonzero scalar multiple of 
x is also an eigenvector of A. 


(c) To find the eigenvalue(s) of an n x n matrix A, you can 
solve the characteristic equation, det(AJ — A) = 0. 


62. (a) Geometrically, if A is an eigenvalue of a matrix A and x is an 
eigenvector of A corresponding to A, then multiplying x by 
A produces a vector Ax parallel to x. 


(b) Ann x n matrix A can have only one eigenvalue. 


(c) If Ais ann x n matrix with an eigenvalue A, then the set of 
all eigenvectors of A is a subspace of R”. 


In Exercises 63-66, find the dimension of the eigenspace correspon- 
ding to the eigenvalue A = 3. 


63. 


65. 


67. 


68. 


69. 


3 0 0 3) 1 0 
A= |0 3 0 64. A = 1/0 3 0 

0 0 3 0 0 3 

3 1 0 3 1 1 
A= |0 3 1 66. A =|0 3 1 

0 0 3 0 0 3 
Calculus Let T: C’[0, 1] C[O, 1] be given by 7(f) =f” 


Show that A = 1 is an eigenvalue of T with corresponding 
eigenvector f(x) = e*. 


Calculus For the linear transformation given in Exercise 67, 
find the eigenvalue corresponding to the eigenvector 


f(x) =e-*. 
Let T: P, — P, be represented by 
ax”) = (—3a, + Sa) 4 

(—4ay + 4a, — 10a,)x + 4a,x?. 
Find the eigenvalues and the eigenvectors of T relative to the 
standard basis {1, x, x7}. 


Tay + a,x 4 


7.2 


70. 


71. 


72. 


73. 


74. 


75. 


Diagonalization 
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Let T: P,; > P, be represented by 


T(dy + a,x + ayx?) = (2a, + a, — ay) 4 
(—a, + 2a)x — ayx?. 
Find the eigenvalues and eigenvectors of T relative to the 
standard basis {1, x, x}. 
Let T: M,, > M,,, be represented by 


7(|¢ N)=| a- ct+d b4 ‘|| 
c d\) |-2a+2c-2d 2b+2d} 


Find the eigenvalues and eigenvectors of T relative to the 
standard basis 


o={[o able obi oblo i} 


A square matrix A is called idempotent if A? = A. What are the 
possible eigenvalues of an idempotent matrix? 


A square matrix A is called nilpotent if there exists a positive 
integer k such that A* = 0. What are the possible eigenvalues of 
a nilpotent matrix? 


Find all values of the angle 6 for which the matrix 
A= (es @ —sin ll 
sin@ cos @ 
has real eigenvalues. Interpret your answer geometrically. 


Let A be ann Xx n matrix such that the sum of the entries in each 
row is a fixed constant r. Prove that r is an eigenvalue of A. 
Illustrate this result with a specific example. 


The preceding section discussed the eigenvalue problem. In this section, you will look at 
another classic problem in linear algebra called the diagonalization problem. Expressed in 
terms of matrices*, the problem is this: “For a square matrix A, does there exist an invert- 
ible matrix P such that P~'AP is diagonal?” 

Recall from Section 6.4 that two square matrices A and B are called similar if there 
exists an invertible matrix P such that B = P~'AP. 

Matrices that are similar to diagonal matrices are called diagonalizable. 


Definition of a 
Diagonalizable Matrix 


An n x n matrix A is diagonalizable if A is similar to a diagonal matrix. That is, A is 
diagonalizable if there exists an invertible matrix P such that P~'AP is a diagonal matrix. 


* At the end of this section, the diagonalization problem will be expressed in terms of linear transformations. 
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EXAMPLE 1 


Provided with this definition, the diagonalization problem can be stated as follows: 
“Which square matrices are diagonalizable?” Clearly, every diagonal matrix D is diagonal- 
izable, because the identity matrix J can play the role of P to yield D = J~'DJ. Example 1 
shows another example of a diagonalizable matrix. 


A Diagonalizable Matrix 


THEOREM 7.4 
Similar Matrices Have 
the Same Eigenvalues 


PROOF 


The matrix from Example 5 in Section 6.4, 


1 3 0 
A=]3 1 0}, 
0 Q. = 2 


is diagonalizable because 


1 £ 20 
P=|1 -1 0 
0 0 1 


has the property 


4 0 0 
P-'AP=|0 —2 0]. 
0 Q. =2 


As indicated in Example 8 in the preceding section, the eigenvalue problem is related 
closely to the diagonalization problem. The next two theorems shed more light on this 
relationship. The first theorem tells you that similar matrices must have the same eigenvalues. 


If A and B are similar n x n matrices, then they have the same eigenvalues. 


Because A and B are similar, there exists an invertible matrix P such that B = P~'AP. By 
the properties of determinants, it follows that 


|AZ — B| = |AI — P-!AP| = |P-!AIP — P7!AP| 
= |P-'(Al — A)P| 
= |P“||AI — A||P| 
= |Po!||P||AZ — Al 
= |P"!P||AI — Al 
= |AI— Al. 


EXAMPLE 2 
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But this means that A and B have the same characteristic polynomial. So, they must have 
the same eigenvalues. 


Finding Eigenvalues of Similar Matrices 


SOLUTION 


THEOREM 7.5 
Condition for 
Diagonalization 


The matrices A and D are similar. 


1 0 0 1 0 0 
A= |-1 1 1 and D=]0 2 0 
=] ~=2 4 0 0 3 


Use Theorem 7.4 to find the eigenvalues of A and D. 


Because D is a diagonal matrix, its eigenvalues are simply the entries on its main 
diagonal—that is, 


A, = 1, 
A, = 2, and 
Az = 3. 


Moreover, because A is said to be similar to D, you know from Theorem 7.4 that A has the 
same eigenvalues. Check this by showing that the characteristic polynomial of A is 


JAI — Al = (A — 1)(A — 2)(A — 3). 


REMARK: Example 2 simply states that matrices A and D are similar. Try checking 
D = P~'AP using the matrices 


1 0 0 1 0 0 
P=)1 1 1 and P'!=|-1 2 = 
1 1 2 Qo] 1 


In fact, the columns of P are precisely the eigenvectors of A corresponding to the 
eigenvalues 1, 2, and 3. 


The two diagonalizable matrices in Examples 1| and 2 provide a clue to the diagonaliza- 
tion problem. Each of these matrices has a set of three linearly independent eigenvectors. 
(See Example 3.) This is characteristic of diagonalizable matrices, as stated in Theorem 7.5. 


An nxn matrix A is diagonalizable if and only if it has n linearly independent 
eigenvectors. 
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PROOF First, assume A is diagonalizable. Then there exists an invertible matrix P such that 


P~'AP = D is diagonal. Letting the main entries of D be A,, A,,. . . , A,, and the column 
vectors of P be p), p5,. . ., p,, produces 
A, 0 0 
: O A 0 
PD = [pyr Bet > 2? s P,] ° 
0 0 An 
= [AP } Ago EE AP: 
Because P~'AP = D, AP = PD, which implies 
[Ap, : Ap, !- >? Ap,] = [Ap } App. f+ - - t A,P, 


In other words, Ap; = A,p; for each column vector p;. This means that the column vectors 
p,; of P are eigenvectors of A. Moreover, because P is invertible, its column vectors are 
linearly independent. So, A has n linearly independent eigenvectors. 


Conversely, assume A has n linearly independent eigenvectors p,, p5,. ..,p, with 
corresponding eigenvalues A,, Az,. . . , A,,. Let P be the matrix whose columns are these n 
eigenvectors. That is, P =[p, : p> :---! p,|. Because each p, is an eigenvector of A, 
you have Ap; = A,p, and 

AP = Alp, ? Poi ++ - i Pal = [Ai $ Aw. f-* E A Pal: 
The right-hand matrix in this equation can be written as the matrix product below. 
4, O -:: O 
P : : 0 A, -:: «(0 
AP = "(py Pes * 3 Ball 3 2 » | = PD 
@.<O- 49 
Finally, because the vectors p,, p5,. . .,p,, are linearly independent, P is invertible and 


you can write the equation AP = PD as P~'AP = D, which means that A is diagonalizable. 


A key result of this proof is the fact that for diagonalizable matrices, the columns of P 
consist of the n linearly independent eigenvectors. Example 3 verifies this important 
property for the matrices in Examples 1| and 2. 


EXAMPLE 3| Diagonalizable Matrices 


(a) The matrix in Example 1 has the eigenvalues and corresponding eigenvectors listed 
below. 


1 1 0 
A =4P,=[1) 4=-2.pR=)/-1] A,= -2,p, =|0 
0 0 1 


Steps for Diagonalizing 
ann x n Square Matrix 


EXAMPLE 4 
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The matrix P whose columns correspond to these eigenvectors is 


1 1 0 
P=|1 -1 0}. 
0 0 1 


Moreover, because P is row-equivalent to the identity matrix, the eigenvectors py, p5, 
and p, are linearly independent. 


(b) The matrix in Example 2 has the eigenvalues and corresponding eigenvectors listed 


below. 
1 0 0) 
A =Lp=llp A =2,p.=]1); As =3,p; =] 1 
1 1 2 


The matrix P whose columns correspond to these eigenvectors is 


1 0 0 
P=/1 1 1}. 
1 1 2 


Again, because P is row-equivalent to the identity matrix, the eigenvectors p,, p, and 
p; are linearly independent. 


The second part of the proof of Theorem 7.5 and Example 3 suggest the steps listed below 
for diagonalizing a matrix. 


Let A be ann xX n matrix. 


ile 


Find n linearly independent eigenvectors p,, p>,. . ..p,, for A with corresponding 
eigenvalues A,,A,,.. .,A,. If n linearly independent eigenvectors do not exist, then 
A is not diagonalizable. 


. If A has n linearly independent eigenvectors, let P be the n x n matrix whose columns 


consist of these eigenvectors. That is, 


P=(|p,:p: + ~~: pl 


. The diagonal matrix D = P~'AP will have the eigenvalues A,,A,. . .,A,, on its main 


diagonal (and zeros elsewhere). Note that the order of the eigenvectors used to form P 
will determine the order in which the eigenvalues appear on the main diagonal of D. 


A Matrix That Is Not Diagonalizable 


Show that the matrix A is not diagonalizable. 
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SOLUTION 


EXAMPLE 5 


Because A is triangular, the eigenvalues are simply the entries on the main diagonal. So, the 
only eigenvalue is A = 1. The matrix (J — A) has the reduced row-echelon form shown 


belo WwW. 


This implies that x, = 0, and letting x, = f, you can find that every eigenvector of A has 
the form 


ETA 


So, A does not have two linearly independent eigenvectors, and you can conclude that A is 
not diagonalizable. 


Diagonalizing a Matrix 


SOLUTION 


Show that the matrix A is diagonalizable. 


1 =] =1 
A= 1 3 1 
=3 | oe | 


Then find a matrix P such that P~'AP is diagonal. 


The characteristic polynomial of A is 


A-1 1 1 
|AI — A| = =i A—3 —1] = (A — 2)(A + 2)(A — 3). 
3 -l Atti 
So, the eigenvalues of A are A, = 2, A, = —2, and A, = 3. From these eigenvalues you 


obtain the reduced row-echelon forms and corresponding eigenvectors shown below. 


Eigenvector 

1 1 1 0 1 —1 

2I-Az= 1 1 1) — |0 1 0 0 
3. = 1 3 0 0 0 1 

ag. i Os, 1 
2-A=|-1 -5 -1| —» |o 1 j -] 
2 =) =1 0 0 0 4 

2 1 1 1 0 -1 

31 -A=]|-1 O —1] ay. |0 1 - 1 
3.0 =] 4 0 0 1 
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Form the matrix P whose columns are the eigenvectors just obtained. 


-1 1-1 
P=| 0-1 1 
il 4 1 


This matrix is nonsingular, which implies that the eigenvectors are linearly independent and 
A is diagonalizable. The inverse of P is 


-1 -l 0) 
pis| 3 0 41, 
1 1 
5 Jt & 
and it follows that 
2 0) 0) 
P'AP=|0 -2 QO}. 
0) 0 3 


EXAMPLE 6| Diagonalizing a Matrix 


Show that the matrix A is diagonalizable. 


1 0 0 0 
1 = 
ges 5 —10 
1 0 2 0 
1 0 0 3 


Then find a matrix P such that P~!AP is diagonal. 


SOLUTION In Example 6 in Section 7.1, you found that the three eigenvalues A, = 1, A, = 2, and 
A, = 3 have the eigenvectors shown below. 


0) [-2 0 0 
1 0 5 —5 
Alok | 5 Aa] As] 5 
0 1 0 1 


The matrix whose columns consist of these eigenvectors is 


0 -2 0 0 
1 0 3 =5 
0 2 1 oO; 
0 1 0 1 
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Because P is invertible (check this), its column vectors form a linearly independent set. 


-2 1 -5 5 
1 
+ 0 0 0 
pt.) = 
1 0 1 0 
; Oo @ 7 


So, A is diagonalizable, and you have 


l 
1 

p-lap =|° 
0 0 
0 0 


For a square matrix A of order n to be diagonalizable, the sum of the dimensions of the 
eigenspaces must be equal to n. One way this can happen is if A has n distinct eigenvalues. 
So, you have the next theorem. 


THEOREM 7.6 
Sufficient Condition 
for Diagonalization 


If an n x n matrix A has n distinct eigenvalues, then the corresponding eigenvectors are 
linearly independent and A is diagonalizable. 


PROOF Let A,,A,,...,A,, be n distinct eigenvalues of A corresponding to the eigenvectors 
X|,X>,. . .,X,,. To begin, assume the set of eigenvectors is linearly dependent. Moreover, 
consider the eigenvectors to be ordered so that the first m eigenvectors are linearly independ- 
ent, but the first m + 1 are dependent, where m < n. Then x,, ,, can be written as a linear 
combination of the first m eigenvectors: 


Xmt1 = CyXy + KX. t+ ++ +e,x Equation 1 


m*m? 


where the c;’s are not all zero. Multiplication of both sides of Equation | by A yields 


AX,,41; = Ac,X, + Ac,x, +++ + + Ac,,x 


mum 


Amt ki = CiAqX + GA QXy Pes + CA, x Equation 2 


m*~m*m? 


whereas multiplication of Equation | by A,, ,, yields 


Xm+1Xm+1 a CUA 1X + CoAm 41% are SCG AmtiXm- Equation 3 


m 


Now, subtracting Equation 2 from Equation 3 produces 


Ci Agey — Aye F Gg ~ A eg ee eh A se, = 0, 


m m 


and, using the fact that the first m eigenvectors are linearly independent, you can conclude 
that all coefficients of this equation must be zero. That is, 


On 4 a A) = CoA +t -_ X») ae = Nad = dn) = 0, 


EXAMPLE 7 
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Because all the eigenvalues are distinct, it follows that c; = 0,i = 1,2,. ..,m. But this 
result contradicts our assumption that x,,,, can be written as a linear combination of the 
first m eigenvectors. So, the set of eigenvectors is linearly independent, and from Theorem 
7.5 you can conclude that A is diagonalizable. 


Determining Whether a Matrix Is Diagonalizable 


SOLUTION 


EXAMPLE 8 


Determine whether the matrix A is diagonalizable. 


1 =2 1 
A= /0 0 1 
0 Q 3 


Because A is a triangular matrix, its eigenvalues are the main diagonal entries 
A, = 1, A, = 0, A3 = —3. 


Moreover, because these three values are distinct, you can conclude from Theorem 7.6 that 
A is diagonalizable. 


REMARK: Remember that the condition in Theorem 7.6 is sufficient but not necessary for 
diagonalization, as demonstrated in Example 6. In other words, a diagonalizable matrix 
need not have distinct eigenvalues. 


Diagonalization and Linear Transformations 


So far in this section, the diagonalization problem has been considered in terms of 
matrices. In terms of linear transformations, the diagonalization problem can be stated as 
follows. For a linear transformation 


T: VV, 
does there exist a basis B for V such that the matrix for T relative to B is diagonal? The 


answer is “yes,” provided the standard matrix for T is diagonalizable. 


Finding a Diagonal Matrix for a Linear Transformation 


Let T: R? > R? be the linear transformation represented by 
T (X15 X55 X3) = (X1 — X> — X3,.X, + 3x, + x3, —3x, +X — X3). 


If possible, find a basis B for R? such that the matrix for T relative to B is diagonal. 


444 Chapter 7 Eigenvalues and Eigenvectors 


SOLUTION The standard matrix for T is represented by 


1 =i =1 
A= 1 3 1}. 
=3 1 =1 


From Example 5, you know that A is diagonalizable. So, the three linearly independent 
eigenvectors found in Example 5 can be used to form the basis B. That is, 


B = {(-1,0, 1), 0, -1, 4), (-1, 1, 1}. 


The matrix for T relative to this basis is 


2 0 0 
D=|0 -2 0}. 
0 0 3 
AN eve Exercises 
In Exercises 1-8, verify that A is diagonalizable by computing In Exercises 9-16, show that the matrix is not diagonalizable. 
P-lAP. u 
9 I; | 10 1 5 
La=| ob P= |_4 = 5 0 i. 34 
—-3 10 =[, ->] ‘ i ; 6 
1 3 2 1 11 12 
na=[i heeft | lo Ll 
=] 5 1 1 
9 4 i at 1 —2 1 2 1 -1 
3. A= I ip RS I I 13. | 0 1 4 14./0 —-1 2 
4 5 i 5 0 0 2 0 0 -i1 
4,.A= , P= = a 
fhe oe a ee 
— 15. 16. 
5. A= : ' P : i : a 2 0 2-2 mel-2 0 1 1 
—. ey a 2 G 2 : 1 0 0 0 
4-2 5 1 2 2 (See Exercise 37, (See Exercise 38, 
2 3 1 1 1 5 Section 7.1.) Section 7.1.) 
6A=|0 —-1 2),P=|]0 —-1 In Exercises 17-20, find the eigenvalues of the matrix and determine 
0 0 3 0 0 2 whether there is a sufficient number to guarantee that the matrix is 
ey 3 1 1-2 diagonalizable. (Recall that the matrix may be diagonalizable even 
though it is not guaranteed to be diagonalizable by Theorem 7.6.) 
7,.A=1/0 2 1|, P=|0 2 
0 0 3 0 0 1 v7. k i 18. P | 
1 1 5 2 
0.80 0.10 0.05 0.05 1 =1 0 1 
a8} 8. 4-010 0:80 0.05 005} ,_]1 -1 0 -1 — <r 
fa 0.05 0.05 0.80 0.10) 1 1 1 0 Bee |i oe 2 2.;0 1 1 
ie 0.05 0.05 0.10 0.80 1 1-1 #0 “to -2 5 0 0 -2 


In Exercises 21-34, for each matrix A, find (if possible) a nonsin- 
gular matrix P such that P~'AP is diagonal. Verify that P ~'AP is 
a diagonal matrix with the eigenvalues on the diagonal. 


a1. =| . “| 
—2 1 


(See Exercise 15, 
Section 7.1.) 


1 -3 
=|) ] 
7 —l 


(See Exercise 17, 
Section 7.1.) 


2 =2 3 
25. A =|0 3 -=2 
0 -1 2 
(See Exercise 21, 
Section 7.1.) 
1 2. 
27. A=|-—2 a 2 
—6 6 -—3 
(See Exercise 23, 
Section 7.1.) 
0 —-3 5 
29. A =|—4 4 —-10 
0 0 4 


(See Exercise 25, 
Section 7.1.) 


1 0 
31L.A=|1 2 
1 0 
x» 
wae 
0 1 
0 0 


- - CO OC 
oo 


=2 


1 -4 
ma=|) 3] 
—2 8 


(See Exercise 16, 
Section 7.1.) 


1 1 
4 4 
1 

2 0 


(See Exercise 18, 
Section 7.1.) 


| 


3 2 1 
26. A =|0 0 2 
0 2 0 


(See Exercise 22, 
Section 7.1.) 


3 2, =3 
28. A=|-3 —-4 9 
=|. =2 5 
(See Exercise 24, 
Section 7.1.) 
3 5 
1-3 2 
30.A=|-2 3 -10 
3 9 
a 8 
(See Exercise 26, 
Section 7.1.) 
4 0 0 
32. A=}2 2 0 
0 2 2 
1 0 0 0 
1 1 
34, A = ‘ " 
0 0 1 0 
0 1 0 1 


In Exercises 35-38, find a basis B for the domain of T such that the 
matrix of T relative to B is diagonal. 


35. T: R?->R?: T(x, y) = (x + y,x + y) 


36. T: R?—> R?*: T(x, y, z) = (—2x + 2y 


3z,2x + y 


—x — 2y) 


37. T: P,P: Tla 4 


bx) =a 


+ (a + 2b)x 


38. T: P; > P5: Tay 4 


a,x 4 


ay) +4 


(3a, + 4a,)x + a,x? 


dx?) = (2a 
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39. Let A be a diagonalizable n x n matrix and P an invertible 
n X n matrix such that B = P~'AP is the diagonal form of A. 
Prove that 

(a) Bk = P~!A*P, where k is a positive integer. 
(b) A‘ = PB‘P~!, where k is a positive integer. 
40. Let A,,A,,. . .,A, be n distinct eigenvalues of the n xn 


matrix A. Use the result of Exercise 39 to find the eigenvalues 
of A‘. 


In Exercises 41-44, use the result of Exercise 39 to find the 
indicated power of A. 


aa=[° Le aa-[l fe 
=6 -11 2 0 
3 2 =3 2 Q +2 
43.A=|/-3 —4 9), A’ 44.A =/0 2 —2),A9 
=f 2 5 ) 0 —3 


True or False? In Exercises 45 and 46, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, 
provide an example that shows the statement is not true in all cases 
or cite an appropriate statement from the text. 


45. (a) If A and B are similar n x n matrices, then they always have 
the same characteristic polynomial equation. 


(b) The fact that an n x n matrix A has n distinct eigenvalues 
does not guarantee that A is diagonalizable. 


46. (a) If A is a diagonalizable matrix, then it has n linearly 
independent eigenvectors. 


(b) If an n x n matrix A is diagonalizable, then it must have n 
distinct eigenvalues. 


47. Writing Can a matrix be similar to two different diagonal 
matrices? Explain your answer. 


48. Are the two matrices similar? If so, find a matrix P such that 
B= P"'AP. 


1 0 0 3 0 0 
A=|0 2 0 B=10 2 0 
0 0 3 0 0 1 


49. Prove that if A is diagonalizable, then A’ is diagonalizable. 
50. Prove that the matrix 


a-[O a 


is diagonalizable if —4bc < (a — d)? and is not diagonalizable 
if —4be > (a — d)?. 
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51. Prove that if A is diagonalizable with n real eigenvalues A,, 


Ay,» +, Ay, then [A] = AyAz* + +A, 
52. Calculus If x is a real number, then e* can be defined by the 
series 
; x2 x3 oA 
@=1txt + + — 42> 
2! 3! =! 
Ina similar way, if X is a square matrix, you can define e* by the 
series 
1 1 1 
e=1+X+ 2X? + —-X34+—KX4*+--- 
2! 3! 4! 
Evaluate e*, where X is the indicated square matrix. 
1 0 0 0 
X= b) X = 
” lo ql . lo 4 


x-|! ° ax-[° i 
OST OF l1 4 


x=(5 | 
()X=|) _, 


53. Guided Proof Prove that if the eigenvalues of a diagonaliz- 
able matrix A are all +1, then the matrix is equal to its 
inverse. 


Getting Started: To show that the matrix is equal to its 
inverse, use the fact that there exists an invertible matrix P such 
that D = P~'!AP, where D is a diagonal matrix with +1 along 
its main diagonal. 


(i) Let D = P~'!AP, where D is a diagonal matrix with +1 
along its main diagonal. 
(ii) Find A in terms of P, P~!, and D. 


(iii) Use the properties of the inverse of a product of 
matrices and the fact that D is diagonal to expand to 
find A7!. 


(iv) Conclude that A~! = A. 


54. Guided Proof Prove that nonzero nilpotent matrices are not 
diagonalizable. 

Getting Started: From Exercise 73 in Section 7.1, you know 
that 0 is the only eigenvalue of the nilpotent matrix A. Show that 
it is impossible for A to be diagonalizable. 

(i) Assume A is diagonalizable, so there exists an invertible 
matrix P such that P~'AP = D, where D is the zero 
matrix. 

(ii) Find A in terms of P, P~!, and D. 

(iii) Find a contradiction and conclude that nonzero nilpo- 

tent matrices are not diagonalizable. 


55. Prove that if A is a nonsingular diagonalizable matrix, then A! 
is also diagonalizable. 


In Exercises 56 and 57, show that the matrix is not diagonalizable. 
Then write a brief statement explaining your reasoning. 


56. iF if k#0 57. ke | 
0 3 0 k 


7.3 | Symmetric Matrices and Orthogonal Diagonalization 


For most matrices you must go through much of the diagonalization process before you can 
finally determine whether diagonalization is possible. One exception is a triangular matrix 
with distinct entries on the main diagonal. Such a matrix can be recognized as diagonaliz- 
able by simple inspection. In this section you will study another type of matrix that is 
guaranteed to be diagonalizable: a symmetric matrix. 


Definition of 


Symmetric Matrix aes 


A square matrix A is symmetric if it is equal to its transpose: 


You can determine easily whether a matrix is symmetric by checking whether it is 
symmetric with respect to its main diagonal. 
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EXAMPLE 1| Symmetric Matrices and Nonsymmetric Matrices 


The matrices A and B are symmetric, but the matrix C is not. 


Discovery o 1 
A= 1 3 0 Symmetric 
lf you have access to a computer 2 Oo 5 
software program or a graphing 
a ee 4 3 
utility that can find eigenvalues, B= 3 | Symmetric 


try the following experiment. Pick 
an arbitrary square matrix and 3 2 1 
calculate its eigenvalues. Can C=-l1 -4 0 Nonsymmetric 
you find a matrix for which the 1 0 5 


eigenvalues are not real? 

Now pick an arbitrary symmetric 
matrix and calculate its eigen- 
values. Can you find a symmetric 


Nonsymmetric matrices have the following special properties that are not exhibited by 
symmetric matrices. 


matrix for which the eigenvalues 1. A nonsymmetric matrix may not be diagonalizable. 

are not real? What can you 2. A nonsymmetric matrix can have eigenvalues that are not real. For instance, the matrix 
conclude about the eigenvalues 0-1 

of a symmetric matrix? A= F | 


has a characteristic equation of A* + 1 = 0. So, its eigenvalues are the imaginary 
numbers A, = i and A, = —i. 

3. For a nonsymmetric matrix, the number of linearly independent eigenvectors corre- 
sponding to an eigenvalue can be less than the multiplicity of the eigenvalue. (See 
Example 4, Section 7.2.) 


None of these three properties is exhibited by symmetric matrices. 


THEOREM 7.7 — If A is ann x n symmetric matrix, then the following properties are true. 


Eigenvalues of 1. A is diagonalizable. 
Symmetric Matrices 2. All eigenvalues of A are real. 
3. If A is an eigenvalue of A with multiplicity k, then A has k linearly independent 
eigenvectors. That is, the eigenspace of A has dimension k. 


REMARK: Theorem 7.7 is called the Real Spectral Theorem, and the set of eigenvalues 
of A is called the spectrum of A. 


A general proof of Theorem 7.7 is beyond the scope of this text. The next example 
verifies that every 2 x 2 symmetric matrix is diagonalizable. 
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EXAMPLE 2 


The Eigenvalues and Eigenvectors of a 2 x 2 Symmetric Matrix 


SOLUTION 


EXAMPLE 3 


Prove that a symmetric matrix 


is diagonalizable. 
The characteristic polynomial of A is 


A-a 0 és 5 
—A|= = 2. 
|Al — Al | ‘ A (a+ b)A+ab-c 


As a quadratic in A, this polynomial has a discriminant of 
(a + b)? — 4(ab — c?) = a + 2ab + b* — 4ab + 4c? 
= a’ — 2ab + b? + 4c? 
= (a — b)? + 4c?. 


Because this discriminant is the sum of two squares, it must be either zero or positive. 
If (a — b)? + 4c? = 0, then a = b and c = 0, which implies that A is already diagonal. 
That is, 


On the other hand, if (a — b)? + 4c? > 0, then by the Quadratic Formula the character- 
istic polynomial of A has two distinct real roots, which implies that A has two distinct real 
eigenvalues. So, A is diagonalizable in this case also. 


Dimensions of the Eigenspaces of a Symmetric Matrix 


SOLUTION 


Find the eigenvalues of the symmetric matrix 


tL. =2 0 0 
=2 1 0 0 
0 0 lL =2 
0 0 =2 1 


A= 


and determine the dimensions of the corresponding eigenspaces. 


The characteristic polynomial of A is represented by 


A-1 2 0 0 

oe 2 A-1 0 0] _ oe. Ss 

lar — Al = : A om 5 = A+ IPA = 3) 
0 0 2 A-1 


Definition of an 
Orthogonal Matrix 


EXAMPLE 4 
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So, the eigenvalues of A are A, = —1 and A, = 3. Because each of these eigenvalues has 
a multiplicity of 2, you know from Theorem 7.7 that the corresponding eigenspaces also 
have dimension 2. Specifically, the eigenspace of A, = — | has a basis of B, ={(1, 1, 0, 0), 
(0, 0, 1, 1)} and the eigenspace of A, = 3 has a basis of B, = {(1, —1, 0, 0), (0, 0, 1, —1)}. 


Orthogonal Matrices 


To diagonalize a square matrix A, you need to find an invertible matrix P such that P~'AP 
is diagonal. For symmetric matrices, you will see that the matrix P can be chosen to have 
the special property that P~! = P’. This unusual matrix property is defined as follows. 


A square matrix P is called orthogonal if it is invertible and if 


jo EE 


Orthogonal Matrices 


(a) The matrix 


Il 
P= 
=] 0 
is orthogonal because 
p-l = pr= b “al 
1 0 
(b) The matrix 


3 4 
5 O -3 
P=|0 1 0 
4 3 
5 O 5 
is orthogonal because 
3 4 
5 O 5 
P-!=pTr=!| 0 1 0 
4 3 
“3 2 & 


In parts (a) and (b) of Example 4, the columns of the matrices P form orthonormal sets in 
R? and R’, respectively. This suggests the next theorem. 
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THEOREM 7.8 


Property of Ann xn matrix P is orthogonal if and only if its column vectors form an orthonormal set. 


Orthogonal Matrices 


PROOF Suppose the column vectors of P form an orthonormal set: 


Pe [p,: P2 sc Pp, 
Pu Pi2 Pin 
Pr ~=P22 Pon 
Pm Pa Pa 


Then the product P’P has the form 


Pu Pa °°" Pai}|Pu Piz * 7" Pin 
P'p = Pi2 Poa eae Pna Pai P22 = Pon 
Py Pop _—— Pry: Pra Pro ue Pon 
Pi°P: Pi’ Po --- Pit P, 
prp = P2° Pi P27 Po °° + Pot Pa} 
P, * Pi P,° P2 +--+ Ph’ Pr 
Because the set {p,, p>,- - -, P,} is orthonormal, you have 


Po P,=0,i# Jj and p; ¢ p; = |p, |? = 1. 


So, the matrix composed of dot products has the form 


1 O--: 0 
Penl? 2 Ble 
, eee | 


This implies that P’ = P~', and you can conclude that P is orthogonal. 
Conversely, if P is orthogonal, you can reverse the steps above to verify that the column 


vectors of P form an orthonormal set. 
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EXAMPLE 5| An Orthogonal Matrix 


Show that 
1 2 2 
3 3 
2 1 
P= 0 
5 5 

2 4 5 

B/S 375. 35/5 


is orthogonal by showing that PP? = I. Then show that the column vectors of P form an 
orthonormal set. 


SOLUTION Because 


1 2 2\/ 1 2 2 
3 aio wo 35/5 
2 1 2 1 4 
PPT 0 
fh - 75 a fk BS 
2 4 5 2 0 5 
37/5 3/5 3x/5])3 3/5 
1 0 0 
=|0 1 0| = 1,, 
0 0 1 
it follows that P’ = P~!, and you can conclude that P is orthogonal. Moreover, letting 
; 2 
2 1 : 
a p= , and = 0 
P, 5 P2 Js P3 ; 
2 4 > 
= == 3/5 
3/5 3/5 2 


produces 
Pi * Po = Pi * P3 = Po* Ps =O 
and 


[pill = poll = IIpsll = 1. 


So, {P), P>, P3} is an orthonormal set, as guaranteed by Theorem 7.8. 


It can be shown that for a symmetric matrix, the eigenvectors corresponding to distinct 
eigenvalues are orthogonal. This property is stated in the next theorem. 
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THEOREM 7.9 
Property of 
Symmetric Matrices 


PROOF 


EXAMPLE 6 


Let A be ann X n symmetric matrix. If A, and A, are distinct eigenvalues of A, then their 


corresponding eigenvectors x, and x, are orthogonal. 


Let A, and A, be distinct eigenvalues of A with corresponding eigenvectors x, and x,. So, 


Ax, = A,x, and = Ax, = A,x,. 


To prove the theorem, use the matrix form of the dot product shown below. 


Now you can write 
Ay(X, * X5) = (A,X) + X 
= (Ax,) * xX) 
= (Ax,)'x, 
= (x/A")x, 
(x 7A)x, Because A is symmetric, A = A™ 
x/(Ax,) 
= x/(Apx,) 


=X ° (A5Xy) 


= A,(x, * x,). 


This implies that (A, — A,)(x, + x,) = 0, and because A, # A, it follows that x, - x 


So, x, and x, are orthogonal. 


= 0. 


Eigenvectors of a Symmetric Matrix 


SOLUTION 


Show that any two eigenvectors of 


1 

| F sl 

corresponding to distinct eigenvalues are orthogonal. 
The characteristic polynomial of A is 

ji =3 =i 


I- Al = 
ee -1 A-3 


[=@-20 - 4) 


THEOREM 7.10 
Fundamental Theorem 
of Symmetric Matrices 


PROOF 
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which implies that the eigenvalues of A are A, = 2 and A, = 4. Every eigenvector corre- 
sponding to A, = 2 is of the form 


“=| ‘| s#0 
—s 


and every eigenvector corresponding to A, = 4 is of the form 


E 
x, = Acree 
S t 
nom =| |-[{J=sr- 22-0, 
=s t 


and you can conclude that x, and x, are orthogonal. 


So, 


Orthogonal Diagonalization 


A matrix A is orthogonally diagonalizable if there exists an orthogonal matrix P such 
that P~'AP = D is diagonal. The following important theorem states that the set of 
orthogonally diagonalizable matrices is precisely the set of symmetric matrices. 


Let A be ann x n matrix. Then A is orthogonally diagonalizable and has real eigenvalues 
if and only if A is symmetric. 


The proof of the theorem in one direction is fairly straightforward. That is, if you assume A 
is orthogonally diagonalizable, then there exists an orthogonal matrix P such that 
D = P~'AP is diagonal. Moreover, because P~! = P™, you have A = PDP~! = PDP’, 
which implies that A” = (PDP’)? = (P7)’D™P? = PDP? = A. So, A is symmetric. 

The proof of the theorem in the other direction is more involved, but it is 
important because it is constructive. Assume A is symmetric. If A has an eigenvalue A of 
multiplicity k, then by Theorem 7.7, A has k linearly independent eigenvectors. Through the 
Gram-Schmidt orthonormalization process, this set of k vectors can be used to form an 
orthonormal basis of eigenvectors for the eigenspace corresponding to A. This procedure is 
repeated for each eigenvalue of A. The collection of all resulting eigenvectors is orthogonal 
by Theorem 7.9, and you know from the normalization process that the collection is also 
orthonormal. Now let P be the matrix whose columns consist of these 7 orthonormal eigen- 
vectors. By Theorem 7.8, P is an orthogonal matrix. Finally, by Theorem 7.5, you can 
conclude that P~'AP is diagonal. So, A is orthogonally diagonalizable. 
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Determining Whether a Matrix Is Orthogonally Diagonalizable 


SOLUTION 


Orthogonal Diagonalization 
of a Symmetric Matrix 


EXAMPLE 8 


Which matrices are orthogonally diagonalizable? 


i 4 4 * 2. 7 
A=\t © 1 A,=|2' f 8 
i tf -1 8 0 
3 2 0 0 0 
aL 0 1 4=[) 1] 
2 0 1 0 -2 


By Theorem 7.10, the orthogonally diagonalizable matrices are the symmetric ones: A, 
and A,. 


It was mentioned that the second part of the proof of Theorem 7.10 is constructive. That 
is, it gives you steps to follow to diagonalize a symmetric matrix orthogonally. These steps 
are summarized as follows. 


Orthogonal Diagonalization 


SOLUTION 


Find an orthogonal matrix P that orthogonally diagonalizes 


ran 
A= : 
2 1 
1. The characteristic polynomial of A is 


A+2 =2 


—Al= 
Ar \-| =o: Al 


= (A + 3)(A — 2). 


So the eigenvalues are A, = —3 and A, = 2. 
2. For each eigenvalue, find an eigenvector by converting the matrix AJ — A to reduced 
row-echelon form. 


EXAMPLE 9 
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Eigenvector 


-a-a=| Tal > [ool = La 


4 -2 
a-a=[4 7] 


The eigenvectors (—2, 1) and (1,2) form an orthogonal basis for R?. Each of these 
eigenvectors is normalized to produce an orthonormal basis. 


(220) 1 eee 
P= (2, n) VEO ( Ve 7 


(1, 2) 1 1 2 
Po Ta, ay Vee?) = ice a 


3. Because each eigenvalue has a multiplicity of 1, go directly to step 4. 
4. Using p, and p, as column vectors, construct the matrix P. 


oe 
V5 V5 
oe ee 
JS V5 


Verify that P is correct by computing P~'AP = PTAP. 


P= 


2 1 a a 
melt iv si-fo a 
a es) J5 V5 


Orthogonal Diagonalization 


SOLUTION 


Find an orthogonal matrix P that diagonalizes 


2 2 -2 
A=] 2 -1 41. 
-2 4 -1 


1. The characteristic polynomial of A, |AJ — A| = (A — 3)?(A + 6), yields the eigenvalues 
A, = —6and A, = 3. A, has a multiplicity of | and 4, has a multiplicity of 2. 
2. An eigenvector for A, is v, = (1, —2, 2), which normalizes to 


vi, ( 2 ) 
u == o ? 3 . 
' |v) \3 33 
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3. Two eigenvectors for A, are v> = (2,1,0) and v, = (—2,0,1). Note that v, is 
orthogonal to v, and v3, as guaranteed by Theorem 7.9. The eigenvectors v, and v3, 
however, are not orthogonal to each other. To find two orthonormal eigenvectors for A,, 
use the Gram-Schmidt process as follows. 


These vectors normalize to 


W> 


"= wal (ave) 


Ww; ( 2 4 5 
"8 Iwl \ 3V5° 35° 35)" 


4, The matrix P has u,, u,, and u, as its column vectors. 


1 2 2 
a fh. BS 
P 2 1 4 
a. fB. Ba 5 
2 
3 33/5 
A check shows that 
=6 0 0 
P-'AP = PTAP = 0 2 
0 0 3 
SECTION 7.3 Exercises 
In Exercises 1—6, determine whether the matrix is symmetric. 0 1 =i 9 0 3 5 
WE pees, Mle) mee 
“Lo =1 "Lee ey 7 Ey 
i = 2 1 = ae § =2 1 


4 -2 1 1 =5 + 
3. | 3 1 2 4.|-5 3 6 
1 2 1 —4 6 2 
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In Exercises 7-14, find the eigenvalues of the symmetric matrix. 1 JI0 0 0 gD! 10 
For each eigenvalue, find the dimension of the corresponding 10 10 
eigenspace. 0 oO 1 0 
21. 
3 1 2 0 0 0 0 
ly 4 elo a 3 1 
10” 10 0 O 10 10 
3 0 0 2 1 1 
9. | 0 2 0 10. | 1 2 1 i ‘ ; 3/7 
0 0 2 1 1 2 8 8 
0 2 2 0 4 4 0 1 0 0 
22. 
1/2 0 2 12/4 2 O 09 0 1 0 
> 2 « 4 0 -2 av0 ge -@ 3 
8 8 
0 1 1 2 = =] 
13. | 1 0 1 14. | -1 2? =1 In Exercises 23-32, find an orthogonal matrix P such that PAP 
l 1 1 =f <7 2 diagonalizes A. Verify that PTAP gives the proper diagonal form. 
F : — 1 1 4 2 
In Exercises 15-22, determine whether the matrix is orthogonal. 23. A= i i 24.A = 
J2 3/2 2. 3 
— — = -= 0 1 1 
15 : ; 16 : ? 25. A = eee 26. A=} 1 0 1 
"| v2 V2 }2 01 [v2 Ne 
2 2 3 3 
0 10 10 0 3 0 
, 3 -4 4 3 27.A=|10 5 0 22.A=|3 0 4 
I 2 10 ¢ = 0 4 0 
17. 0 1 0 18. 0 1 0 
3 0 4 3 4 1 .=4 2 =2 2 4 
5 8 29.A=|-1 1 2 30.A=| 2 -2 4 
2 2 2 + + + 
2 6 3 
2 6 3 4 2 0 0 1 1 0 0 
2 a 0 0 1 1 0 0 
: 3 3 0 0 + 2 0 0 1 1 
5) 6 3 0 0 2 + 0 0 1 1 
2 6 3 : : 
True or False? In Exercises 33 and 34, determine whether each 
v2 0 V5 statement is true or false. If a statement is true, give a reason or cite 
3 2 an appropriate statement from the text. If a statement is false, provide 
20 0 2./5 0 an example that shows the statement is not true in all cases or cite an 
5 appropriate statement from the text. 
J/2 J5 1 
6 5 3: 33. (a) Let A be ann x n matrix. Then A is symmetric if and only 


if A is orthogonally diagonalizable. 


(b) The eigenvectors corresponding to distinct eigenvalues are 
orthogonal for symmetric matrices. 
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34. (a) A square matrix P is orthogonal if it is invertible—that is, if 
Pol = PT, 
(b) If A is ann x n symmetric matrix, then A is orthogonally 
diagonalizable and has real eigenvalues. 


35. Prove that if A is an m Xn matrix, then A7A and AA? are 
symmetric. 


36. Find A7A and AA? for the matrix below. 


a-(! 3 | 
“l4 -6 1 


37. 
38. 


39. 


40. 


41. 


Prove that if A is an orthogonal matrix, then |A] = +1. 


Prove that if A and B aren x n orthogonal matrices, then AB and 
BA are orthogonal. 


Show that the matrix below is orthogonal for any value of 6. 


= he 6 —sin 
sin@ cos 6 


Prove that if a symmetric matrix A has only one eigenvalue A, 
then A = AI. 


Prove that if A is an orthogonal matrix, then so are A? and A7!. 


7.4 | Applications of Eigenvalues and Eigenvectors 


Population Growth 


Matrices can be used to form models for population growth. The first step in this process is 
to group the population into age classes of equal duration. For instance, if the maximum 
life span of a member is L years, then the age classes are represented by the n intervals 
shown below. 


Firstage Second age nth age 
class class class 


2) 2). [24 


The number of population members in each age class is then represented by the age 
distribution vector 


xy Number in first age class 

Xy Number in second age class 
x= . |. . 

x, Number in mth age class 


Over a period of L/n years, the probability that a member of the ith age class will survive 
to become a member of the (i + 1)th age class is given by p,, where 


Osp,s1,i=1,2,...,n—-1. 


The average number of offspring produced by a member of the ith age class is given by b,, 
where 


0<b,i=1,2,...,n. 
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These numbers can be written in matrix form, as shown below. 


by b, b, aan D,-1 B, 
p, 0 O «+ 0 0 
A=|0 p, 0 0 Oo 
0 0 0 ) py 6 


Multiplying this age transition matrix by the age distribution vector for a specific time 
period produces the age distribution vector for the next time period. That is, 


AX; = X41. 


This procedure is illustrated in Example 1. 


EXAMPLE 1| A Population Growth Model 


A population of rabbits raised in a research laboratory has the characteristics listed below. 


(a) Half of the rabbits survive their first year. Of those, half survive their second year. The 
maximum life span is 3 years. 


(b) During the first year, the rabbits produce no offspring. The average number of offspring 
is 6 during the second year and 8 during the third year. 


The laboratory population now consists of 24 rabbits in the first age class, 24 in the second, 
and 20 in the third. How many rabbits will be in each age class in | year? 


SOLUTION The current age distribution vector is 


24 0 <age<1 
x, = | 24 1 < age <2 
20 2 < age <3 


and the age transition matrix is 


0 6 8 
A=1/05 0 0}. 
0 0.5 0 


After | year the age distribution vector will be 
0 6 8 || 24 304 0 < age <1 


x, = Ax, =|05 0 O}} 24) =] 12). 1 < age <2 
0 0.5 0] £20 12 2 < age <3 
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EXAMPLE 2 


If the pattern of growth in Example | continued for another year, the rabbit population 
would be 


0 6 8 | | 304 168 0 < age <1 
x, = Ax, =| 0.5 0 0 12) =| 152). 1 < age <2 
0 0.5 0 12 6 2 < age < 3 


From the age distribution vectors x,, X,, and x3, you can see that the percent of rabbits 
in each of the three age classes changes each year. Suppose the laboratory prefers a 
stable growth pattern, one in which the percent in each age class remains the same each 
year. For this stable growth pattern to be achieved, the (n + 1)th age distribution vector 
must be a scalar multiple of the nth age distribution vector. That is, Ax, = X,,, = AX,,. 
So, the laboratory can obtain a growth pattern in which the percent in each age class 
remains constant each year by finding an eigenvector of A. Example 2 shows how to solve 
this problem. 


Finding a Stable Age Distribution Vector 


SOLUTION 


any 


Simulation 

Explore this concept further with an 
electronic simulation available at 
college.hmco.com/picNarsonELA6e. 


Find a stable age distribution vector for the population in Example 1. 
To solve this problem, find an eigenvalue A and a corresponding eigenvector x such that 
Ax = Xx. 


The characteristic polynomial of A is 


A -6 -8 
Jar — A] = |-0.5 A OJ =¥B-3A-2=(+ 1A - 2), 
0 -05 A 


which implies that the eigenvalues are — 1 and 2. Choosing the positive value, let A = 2. 
To find a corresponding eigenvector, row reduce the matrix 2/ — A to obtain 


2 —6 —8 1 0 —16 
—0.5 2 Oo; —» |0 1 —-4). 
0 -—-0.5 2 0 0 0 


So, the eigenvectors of A = 2 are of the form 


x} 16t 16 
x Xs At t| 4 
Xs t 1 


For instance, if tf = 2, then the initial age distribution vector would be 
32 0 < age <1 
x, =| 8 1 < age <2 
2 2 < age < 3 


EXAMPLE 3 
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and the age distribution vector for the next year would be 


0) 6 8} | 32 64 0 < age <1 
x, = Ax, =| 0.5 0 0) 8} =| 16]. 1 < age <2 
0 0.5 0 2 4 2 < age <3 


Notice that the ratio of the three age classes is still 16 : 4: 1, and so the percent of the 
population in each age class remains the same. 


Systems of Linear Differential Equations (Calculus) 


A system of first-order linear differential equations has the form 


Vy = ayy, + AyYz + + + + GinYn 
a 

Yo" = GV, + Ay Vy H+ + + + Ay, Y, 

Yn = aniY\ + n2 V2 ap ete ef QinY 


where each y, is a function of ¢ and y,’ = dy,/dt. If you let 


v1 JI 
y=|*? and y’=]>2 |, 
Yn Yn 


then the system can be written in matrix form as y’ = Ay. 


Solving a System of Linear Differential Equations 


SOLUTION 


Solve the system of linear differential equations. 


yy 4y, 
Yo ~ ~Y2 
y3 = 2ys3 


From calculus you know that the solution of the differential equation y’ = ky is 


y = Cem, 

So, the solution of the system is 
yy = Cie* 
yn = Coe! 


y3 = Ce", 
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The matrix form of the system of linear differential equations in Example 3 is y’ = Ay, or 
Vy 4 0 O}}y 
ye |=|0 -1 Ol y|. 
y3" 0 0  2ILY¥s 


So, the coefficients of ¢ in the solutions y, = C, ei are provided by the eigenvalues of the 
matrix A. 
If A is a diagonal matrix, then the solution of 


y’ = Ay 


can be obtained immediately, as in Example 3. If A is not diagonal, then the solution 
requires a little more work. First attempt to find a matrix P that diagonalizes A. Then the 
change of variables represented by y = Pw and y’ = Pw’ produces 


Pw’ =y’=Ay =APw —» w’=P'APw, 


where P~'AP is a diagonal matrix. This procedure is demonstrated in Example 4. 


EXAMPLE 4| Solving a System of Linear Differential Equations 


Solve the system of linear differential equations. 
yy’ = 3y, + 2y, 
Yo’ = 6y, — Yo 
; : : : 3 2 . 
SOLUTION First find a matrix P that diagonalizes A = 6 ail The eigenvalues of A are A, = —3 
and A, = 5, with corresponding eigenvectors 


n-[f] ow n-[ 


Diagonalize A using the matrix P whose columns consist of p, and p, to obtain 
1 
1 1 _ 4 _ =3 0 
Oe , and P-lAP = . 
33 1 7 


0 > 
The system represented by w’ = P~'APw has the following form. 


joe ] lS | be w,’ = —3w, 
= = : 
Ww,’ 0 5} Lw, wr’ = 5w, 


The solution of this system of equations is 


Blo Ble 


w, =Cie* 


= St 
w, = Cie”. 
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To return to the original variables y, and y,, use the substitution y = Pw and write 


lel le 
V5 —3 1ILwi! 
which implies that the solution is 


y= wptw,= Ce*+ Ce™ 
yy = —3w, + wy = —3Cye~™* + Cre™. 


For the systems of linear differential equations in Examples 3 and 4, you found that each 
y, can be written as a linear combination of e*1’, e4',. . ., e*', where A,, A,,. . ., A, are 
distinct real eigenvalues of the n x n matrix A. If A has eigenvalues with multiplicity 
greater than | or if A has complex eigenvalues, then the technique for solving the system 
must be modified. If you take a course on differential equations you will cover these two 
cases. For now, you can get an idea of the type of modification required from the next two 
systems of linear differential equations. 


1. Eigenvalues with multiplicity greater than 1: The coefficient matrix of the system 


= 0 1 
vt 2 ig A= 
y, = Ay T Ags =4 4 
The only eigenvalue of A is A = 2, and the solution of the system of linear differential 
equations is 
y= C,e* + C,yte* 
yy = (2C, + Cy)e”’ + 2Cyte”’, 
2. Complex eigenvalues: The coefficient matrix of the system 
‘= 0 -1 
a 2 ig A= 
y2~ VW 1 0 


The eigenvalues of A are A, = i and A, = —i, and the solution of the system of linear 
differential equations is 


y, = C,cost+ C,sint 
y, = —C, cost + C, sint. 


Try checking these solutions by differentiating and substituting into the original systems of 
equations. 


Quadratic Forms 


Eigenvalues and eigenvectors can be used to solve the rotation of axes problem introduced 
in Section 4.8. Recall that classifying the graph of the quadratic equation 


ax? + bxy + cy? + dx + ey + f=0 Quadratic equation 
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EXAMPLE 5 


is fairly straightforward as long as the equation has no xy-term (that is, b = 0). If the equa- 
tion has an xy-term, however, then the classification is accomplished most easily by first 
performing a rotation of axes that eliminates the xy-term. The resulting equation (relative to 
the new x’y’-axes) will then be of the form 


a(x’? + e(y? + dx’ + ey’ +f =0. 

You will see that the coefficients a’ and c’ are eigenvalues of the matrix 
or: ee et 

The expression 
ax? + bxy + cy? Quadratic form 


is called the quadratic form associated with the quadratic equation ax* + bxy + cy? + 
dx + ey + f = 0, and the matrix A is called the matrix of the quadratic form. Note that 
the matrix A is symmetric by definition. Moreover, the matrix A will be diagonal if and only 
if its corresponding quadratic form has no xy-term, as illustrated in Example 5. 


Finding the Matrix of a Quadratic Form 


SOLUTION 


3-4 


Figure 7.3 


Find the matrix of the quadratic form associated with each quadratic equation. 
(a) 4x7 + 9y? — 36 = 0 (b) 13x7 — 10xy + 13y? — 72 = 0 


(a) Because a = 4, b = 0, and c = 9, the matrix is 
4 0 
A= 9|" Diagonal matrix (no xy-term) 
(b) Because a = 13, b = —10, and c = 13, the matrix is 


13°, =5 
A= 5 | Nondiagonal matrix (xy-term) 


In standard form, the equation 4x7 + 9y? — 36 = 0 is 


which is the equation of the ellipse shown in Figure 7.3. Although it is not apparent by 
simple inspection, the graph of the equation 13x* — 10xy + 13y? — 72 = Ois similar. In 
fact, if you rotate the x- and y-axes counterclockwise 45° to form a new x ’y’-coordinate 
system, this equation takes the form 


OP WP 


3? 2? 


> 


which is the equation of the ellipse shown in Figure 7.4. 


ry\2 n\2 
Oy 20. 


i =1 
°) 


13x2- 10xy + 13y2-72 =0 


Figure 7.4 


Principal Axes Theorem 
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To see how the matrix of a quadratic form can be used to perform a rotation of axes, 


let 


Then the quadratic expression ax? + bxy + cy* + dx + ey + f can be written in matrix 


form as follows. 
lye "dbdt alse 


= ax + bry + cy? + dx t+eyt+f 


XTAX + [d e|X+f 


If b = 0, no rotation is necessary. But if b # 0, then because A is symmetric, you can apply 
Theorem 7.10 to conclude that there exists an orthogonal matrix P such that PTAP = D is 
diagonal. So, if you let 


PTX = X'= lf 
y 
it follows that X = PX’, and you have 
XTAX = (PX’)TA(PX’) 
= (X’)™PTAPX’ 
= (X’)"DX’. 
The choice of the matrix P must be made with care. Because P is orthogonal, its 


determinant will be +1. It can be shown (see Exercise 55) that if P is chosen so |P| = 1, 
then P will be of the form 


pe < 0 -—sin ‘| 
sin 6 cos 6]’ 


where @ gives the angle of rotation of the conic measured from the positive x-axis to the 
positive x-axis. This brings you to the next theorem, the Principal Axes Theorem. 


For a conic whose equation is ax? + bxy + cy* + dx + ey + f = 0, the rotation given 
by X = PX’ eliminates the xy-term if P is an orthogonal matrix, with |P| = 1, that 
diagonalizes A. That is, 


Xv 0 
PTAP = | : | 
ORAS 
where A, and 1, are eigenvalues of A. The equation of the rotated conic is given by 


AP oy le el Px ef 0) 


466 Chapter 7 Eigenvalues and Eigenvectors 


EXAMPLE 6 


REMARK: Note that the matrix product [d e]PX’ has the form 


[d e]PX’ = (dcos 6 + esin @)x’ + (—dsin 6+ ecos O)y’. 


Rotation of a Conic 


SOLUTION 


Perform a rotation of axes to eliminate the xy-term in the quadratic equation 


13x2 —10xy + 13y? — 72 = 0. 


The matrix of the quadratic form associated with this equation is 


1 = 
=| ul 
=3. 13 
Because the characteristic polynomial of A is 
A — 13 5 
= (A — 13)? — 25 = (A — 8)(A — 18), 
Pog] =@- 38-25 = @- 90-18) 


it follows that the eigenvalues of A are A, = 8 and A, = 18. So, the equation of the rotated 
conic is 
8(x’)? + 18(y’)? — 72 = 0, 


which, when written in the standard form 


GP? OP _, 


32 2 ; 


is the equation of an ellipse. (See Figure 7.4.) 


In Example 6, the eigenvectors of the matrix A are 


1 =] 
x, = 1 and = x,= ip 


which you can normalize to form the columns of P, as follows. 


sin 0 cos 0 


a 
a JD -|or6 pe | 
fa 


Note first that |P| = 1, which implies that P is a rotation. Moreover, because cos 45° = 
1/ /2 = sin 45°, you can conclude that 6 = 45°, as shown in Figure 7.4. 

The orthogonal matrix P specified in the Principal Axes Theorem is not unique. Its 
entries depend on the ordering of the eigenvalues A, and A, and on the subsequent choice 
of eigenvectors x, and x,. For instance, in the solution of Example 6, any of the following 
choices of P (see the next page) would have worked. 


Section 7.4 Applications of Eigenvalues and Eigenvectors 467 


x Xo Xy X> Xy X> 

La 1 oe eee eS uly 
ei ey) aD. x2 sf2 J2 

ws. - ee eed, all. 
2 6) 2 af? 2 “2 

Ay =8.aAz= 18 Ag =18,A5=8 A, = 18.45 =8 
6 = 225° 6 = 135° 6 = 315° 


For any of these choices of P, the graph of the rotated conic will, of course, be the same. 
(See Figure 7.5.) 


4 s 
‘ N 
¢ N 
k 
N 
NX, 
ae x 


r\2 2 
Gy OF _ 4 


n\2 n2 
ey) 24 


: 2 3 


3 a 


Figure 7.5 


The steps used to apply the Principal Axes Theorem are summarized as follows. 


me 


. Form the matrix A and find its eigenvalues A, and A,. 

2. Find eigenvectors corresponding to A, and A,. Normalize these eigenvectors to form the 
columns of P. 

3. If |P| = —1, then multiply one of the columns of P by —1 to obtain a matrix of the 


form 
ie @ —sin A 
P=|., i 
sin@ cos @ 
4. The angle 6 represents the angle of rotation of the conic. 


5. The equation of the rotated conic is A,(x’)? + A,(y’)? + [d e]PX’ + f= 0. 


Example 7 shows how to apply the Principal Axes Theorem to rotate a conic whose 
center has been translated away from the origin. 
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EXAMPLE 7 


Rotation of a Conic 


SOLUTION 


(@’-1)? 0%+4)? | 
i- = 


Figure 7.6 


Perform a rotation of axes to eliminate the xy-term in the quadratic equation 
3x2 — 10xy + 3y2 + 16/2x — 32 =0. 


The matrix of the quadratic form associated with this equation is 


a-| 53 


The eigenvalues of A are A, = 8 and A, = —2, with corresponding eigenvectors of 
x, = (—1, 1) and x, = (—1, —1). This implies that the matrix P is 
oe rere 
2 2 —si 
p= s/t 2 _ bs 0 sin AI where |P| = 1. 
1 1 sin 0 cos 0 


JS2 2 
Because cos 135° = —1/./2 and sin 135° = 1//2, you can conclude that the angle of 
rotation is 135°. Finally, from the matrix product 


ee Per = 
[d elpx’=[16/2 0] ve a | 
72 2 


= —16x’— loy’, 
you can conclude that the equation of the rotated conic is 


8(x’)? — 2(y’)? — 16x’ — l6y’ — 32 = 0. 


In standard form, the equation 
Gia 1P - (yay? 
=] 
1? 2 


is the equation of a hyperbola. Its graph is shown in Figure 7.6. 


Quadratic forms can also be used to analyze equations of quadric surfaces in space, 
which are the three-dimensional analogues of conic sections. The equation of a quadric 
surface in space is a second-degree polynomial of the form 


ax? + by? + cz? + dxy + exz + fyz + gx thy + iz+j = 0. 


There are six basic types of quadric surfaces: ellipsoids, hyperboloids of one sheet, 
hyperboloids of two sheets, elliptic cones, elliptic paraboloids, and hyperbolic paraboloids. 
The intersection of a surface with a plane, called the trace of the surface in the plane, is 
useful to help visualize the graph of the surface in space. The six basic types of quadric 
surfaces, together with their traces, are shown on the next two pages. 
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Ellipsoid 

Pr yp 2 

—+ +521 

eC bP @¢ 
Trace Plane 
Ellipse Parallel to xy-plane 
Ellipse Parallel to xz-plane 
Ellipse Parallel to yz-plane 


The surface is a sphere ifa = b= c #0. 


Zz 
Zz 


xz-trace 


xy-trace 


Hyperboloid of One Sheet 


. 2 2 
x2 y? 2 


+ +>->=1 
gor pe 
Trace Plane 
Ellipse Parallel to xy-plane 
Hyperbola Parallel to xz-plane 
Hyperbola Parallel to yz-plane 


The axis of the hyperboloid corresponds to 
the variable whose coefficient is negative. 


xy-trace 


N 


yz-trace 


Hyperboloid of Two Sheets 


es a ae, =] 
Ce ae Pb 

Trace Plane 

Ellipse Parallel to xy-plane 

Hyperbola Parallel to xz-plane 

Hyperbola Parallel to yz-plane 


The axis of the hyperboloid corresponds to 
the variable whose coefficient is positive. 
There is no trace in the coordinate plane 
perpendicular to this axis. 


yz-trace 


no xy-trace 


i 


xz-trace 


LZ 
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Elliptic Cone 


e yp Bp 

242 _* =9 

er BP Ce 
Trace Plane 
Ellipse Parallel to xy-plane 
Hyperbola Parallel to xz-plane 
Hyperbola Parallel to yz-plane 


The axis of the cone corresponds to the 
variable whose coefficient is negative. The 
traces in the coordinate planes parallel to 
this axis are intersecting lines. 


Elliptic Paraboloid 
2 ¥2 
op 
Trace Plane 
Ellipse Parallel to xy-plane 
Parabola Parallel to xz-plane 
Parabola Parallel to yz-plane 


The axis of the paraboloid corresponds to 
the variable raised to the first power. 


xz-trace 


xy-trace 
(one point) 


y 


yz-trace 


yz-trace Zz Xz-trace 


xy-trace 
(one point) 


Hyperbolic Paraboloid 
_y x 
2-5 Be 
Trace Plane 
Hyperbola Parallel to xy-plane 
Parabola Parallel to xz-plane 
Parabola Parallel to yz-plane 


The axis of the paraboloid corresponds to 
the variable raised to the first power. 


vd 
Zz 


yz-trace 


xy-trace 


xz-trace 


Figure 7.7 


EXAMPLE 8 
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The quadratic form of the equation 

ax? + by* + cz? + dxy + exz + fvz + gx thy t+ iz+j=0 Quadric surface 
is defined as 

ax + by* + cz? + dxy + exz + fyz. Quadratic form 


The corresponding matrix is 


a i =z 

2 2 

d f 

—|= p -£ 

mele 2 

ef . 
2 2 


In its three-dimensional version, the Principal Axes Theorem relates the eigenvalues and 
eigenvectors of A to the equation of the rotated surface, as shown in Example 8. 


Rotation of a Quadric Surface 


SOLUTION 


Perform a rotation of axes to eliminate the xz-term in the quadratic equation 
5x? + 4y? + 527 + 8xz — 36 = 0. 


The matrix A associated with this quadratic equation is 


5 0 4 
A= {0 4 0}, 
4 0 > 


which has eigenvalues of A, = 1, A, = 4, and A, = 9. So, in the rotated x ‘yz ’-system, the 
quadratic equation is (x’)? + 4(y’)? + 9(z’)? — 36 = 0, which in standard form is 
2 ”\2 ‘2 
PF OP, @? _ 
6° 3? 2? 


1. 


The graph of this equation is an ellipsoid. As shown in Figure 7.7, the x’y’z’-axes represent 
a counterclockwise rotation of 45° about the y-axis. Moreover, the orthogonal matrix 


a. og atl 
fi 2 

P= 0 1 0 |, 
1 1 


whose columns are the eigenvectors of A, has the property that PAP is diagonal. 
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aente) eae Exercises 


Population Growth 


In Exercises 1—4, use the age transition matrix A and age distribution 
vector x, to find the age distribution vectors x, and x;. 


we 


> 


10. 


0 2 
A=|1 
3 0) 


10 
om | 40 
4 ie 
»xX, > 
oy! 160 


> 

ll 
— 
al- oO 


0 3 4 12 

A= 1 0 O},x, =} 12 
0 3 0 12 
0 2 2 0 100 

pe: ; 0 0 0 — 100 
0 1 0 0 100 
0 0 §¢ O 100 

. Find a stable age distribution vector for the age transition matrix 


in Exercise 1. 


. Find a stable age distribution vector for the age transition matrix 


in Exercise 2. 


. Find a stable age distribution vector for the age transition matrix 


in Exercise 3. 


. Find a stable age distribution vector for the age transition matrix 


in Exercise 4. 


. A population has the characteristics listed below. 


(a) A total of 75% of the population survives its first year. 
Of that 75%, 25% survives the second year. The maxi- 
mum life span is 3 years. 

(b) The average number of offspring for each member of 
the population is 2 the first year, 4 the second year, and 
2 the third year. 

The population now consists of 120 members in each of the 
three age classes. How many members will there be in each age 
class in 1 year? In 2 years? 

A population has the characteristics listed below. 


(a) A total of 80% of the population survives its first year. 
Of that 80%, 25% survives the second year. The maxi- 
mum life span is 3 years. 

(b) The average number of offspring for each member of the 
population is 3 the first year, 6 the second year, and 3 the 
third year. 


11. 


12. 


The population now consists of 150 members in each of the 
three age classes. How many members will there be in each age 
class in 1 year? In 2 years? 

A population has the characteristics listed below. 

(a) A total of 60% of the population survives its first 
year. Of that 60%, 50% survives the second year. The 
maximum life span is 3 years. 

(b) The average number of offspring for each member of 
the population is 2 the first year, 5 the second year, and 
2 the third year. 

The population now consists of 100 members in each of the 
three age classes. How many members will there be in each age 
class in 1 year? In 2 years? 

Find the limit (if it exists) of A”x, as n approaches infinity for 
the following matrices. 


0 2 a 
a=({ and x-(¢| 
3 0 a 


Systems of Linear Differential Equations 
(Calculus) 


In Exercises 13-18, solve the system of first-order linear differen- 
tial equations. 


13. 


15. 


17. 


yy = 2y, 14. y,’ = —3y, 
y2/ = yy y= yy 
i Hh 16. y= 5y, 
y2' = by. yo" = —2yy 
y3°= 3 y3/ = —3y3 
y= 2y, 18. y,'= —y, 
y2' = Yo yo" = —2yy 
y3'= Ys y3/=  Y3 


In Exercises 19-26, solve the system of first-order linear differen- 
tial equations. 


23. 


yy =y, 7 Ay 20. y\’ y, — 4y, 
y= 2y2 yo" 2y, + 8y5 
y= y, + 2y, 22. y= yy- Yo 

Yo = 2y, + yy Yo" = 2y, + 4y, 

y= — 3y, + 5y3 24. y," = —2y, T Y3 
yy’ = —4y, + 4y, — 10y3 y= 3y, + 4y, 


3 4y, 3 ¥3 


oe) 25. yy =¥,— 2%. + Ys 


iM 
~ 


&o) 26. y,’ = 2y, + yn + 3 
y= dy, + 4y, MH y’= y, ty, 


Mg 3y3 y3 7 Vy T Y3 


‘a 


In Exercises 27-30, write out the system of first-order linear differ- 
ential equations represented by the matrix equation y’ = Ay. Then 
verify the indicated general solution. 


1 1] y, = Cie + Corte’ 
manly ihjmee 
8. A= i | yy Cie’ cost + Cye' sint 
1 1) y, = —Cye'cost + Cye' sint 
f 1 ] y, =C,+ C,cos2t+ C; sin 2r 
29. A=|0 0 1], = 2C; cos 2t — 2C, sin 2t 
0 —-4 O| 3 —4C, cos 2t — 4C, sin 2t 
0 1 0 
30. A = f 0 i 
iL *=3 3 
yy Ce + Cyte! + C,t7e! 
yo = (C, + Cy)el + (C, + 2C,)te! + CPe! 
y3 = (C, + 2C, + 2C,)e" + (Cy + 4C,)te’ + C3p7e! 


Quadratic Forms 


In Exercises 31-36, find the matrix of the quadratic form associated 
with the equation. 

31. x7 + y?-4=0 

32. x7 — 4dxy + ? —-4=0 

33. 9x? + 10xy — 4y? — 36 = 0 

34. 12x7 — 5xy —x + 2y — 20 = 0 

35. 10xy — 10y? + 4x — 48 = 0 

36. 16x7 — 4xy + 20y? — 72 = 0 


In Exercises 37—42, find the matrix A of the quadratic form associ- 
ated with the equation. In each case, find the eigenvalues of A and 
an orthogonal matrix P such that P’AP is diagonal. 

37. 2x? — 3xy — 2y? + 10 =0 

38. 5x? — 2xy + 5y? + 10x — 17 = 0 

39, 13x? + 6/3 xy + Ty? — 16=0 
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40. 3x2 — 2\/3xy + y?2 + 2x + 2V3y =0 
41. 16x2 — 24xy + 9y? — 60x — 80y + 100 = 0 
42. 17x? + 32xy — Ty? — 75 = 0 


In Exercises 43-50, use the Principal Axes Theorem to perform a 
rotation of axes to eliminate the xy-term in the quadratic equation. 
Identify the resulting rotated conic and give its equation in the new 
coordinate system. 

43. 13x? — 8xy + 7y? — 45 = 0 

44. x7 + 4xy + yr? —-9 =0 

45. 7x7 + 32xy — 17y? — 50 = 0 

46. 2x? — 4xy + 5y? — 36 = 0 

47, 2x2 + Axy + 2y? + 6/2x + 2/2y +4=0 

48. 8x2 + 8xy + By? + 10/2x + 26/2y + 31 =0 

49. xy +x-2y+3=0 

50. 5x2 — 2xy + 5y? + 10/2x =0 


In Exercises 51-54, find the matrix A of the quadratic form 
associated with the equation. Then find the equation of the rotated 
quadric surface in which the xy-, xz-, and yz-terms have been 
eliminated. 


51. 3x? — 2xy + 3y? + 822 - 16=0 

52. 2x? + 2y? + 272 + 2xy + 2xz + 2yvz- 1=0 
53. x2 + 2y? + 222 + 2yz7-1=0 

54.07? + yy? + 24+ 2xy-8 =0 


55. Let P be a 2 x 2 orthogonal matrix such that |P| = 1. Show 
that there exists a number 6,0 < 6 < 27, such that 


p= le 6 —sin 
sin 0 cos 6} 
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Vaiaiweas Review Exercises 


In Exercises 1—6, find (a) the characteristic equation of A, (b) the Writing In Exercises 15-18, explain why the matrix is not 
real eigenvalues of A, and (c) a basis for the eigenspace correspon- diagonalizable. 


ding to each eigenvalue. 0 , i 3 
15. A = | 16. A = | | 


2 1 2 1 a 
A= | 2. A = | | es > 
9 4 -3 —4 1 2 17.A =] 1 3 0 18. A=] 0 4 3 
3.A =| —-2 0 6 4,.A=] 0 1 1 0 0 3 0 0 —2 
-1 -4 11 0 0 3 In Exercises 19—22, determine whether the matrices are similar. If 
they are, find a matrix P such that A = P~'BP. 
2 0 1 1 0 4 
= = = 1 0 2 0 
5.A=|0 3 4 6.A=|0 1 -2 9. 4=| | -| 
0 oO 1 i 3) =o 0 2 0 1 
©) In Exercises 7 and 8, use a graphing utility or computer software 0. A= F i B= | fi | 
program to find (a) the characteristic equation of A, (b) the real , 0 3y —4 1 
eigenvalues of A, and (c) a basis for the eigenspace corresponding 1 1 0 1 1 0 
to each eigenvalue. 
21. A =/0 1 1|, B=1]0 1 0 
2 1 0 0 3 0 2 0 0 0 1 0 0 1 
1 2 0 0 1 3 1 0 
7.A = 8. A= a 
re. fo 2 Oo 6 6gaeloe pal aoe 
i 2 0 0 0 4 a aa | 
u 0 0 —2 =3 3 1 


In Exercises 9-12, determine whether A is diagonalizable. If it is, 


find a nonsingular matrix P such that P~!AP is diagonal. In Exercises 23-28, determine whether the matrix is symmetric, 


orthogonal, both, or neither. 
-—2 1 3 2 2 2 


v2 V2 2/5 VS 
9A=] 0 1 2 10. A =| —-2 0 -1 5 3 5) 5. 
- 23. A = 24. A = 
0 0 1 2 1 0 Ji Ji J 2 J5 
1 0 2 2 =1 1 2 2 5 5 
11.A=|0 1 0 12. A=|-2 3 = 2 Re 3 
2 0 1 -1 1 0 3 3 3 
0 0 1 
13. Show that if 0 < 6 < 7, then the transformation for a 25.4 =|0 I 0 6. A= ee 293 0 
counterclockwise rotation through an angle @ has no real , 1 0 1 , 3 3 
eigenvalues. V3 0 re) 
14. For what value(s) of a does the matrix 3 3 
2 I 2 
toe ? i —3 3 3 7 Oo ¢ 
a = 2 2 1 = 
have the characteristics listed below? ae : 7 : 2B : : : 
1 _2 2 -3 0 : 
3 3 3 


(a) A has an eigenvalue of multiplicity 2. 
(b) A has — 1 and 2 as eigenvalues. 
(c) A has real eigenvalues. 


In Exercises 29-32, find an orthogonal matrix P that diagonalizes A. 


29. A = i; | 30. A = | 


4 -3 i = 
2 Oo =1 1 2 0 
31. A = 0 1 0 32. A=}2 1 0 
—1 0 2 0 0 5 


In Exercises 33-40, find the steady state probability vector (if it 
exists) for the matrix. An eigenvector v of ann x n matrix A is called 
a steady state probability vector if Av = v and the components of 
v add up to 1. 


2 1 1 1 
33 |i ] u4=|; | 
y 4 > 0 
3 2 2 
0.8 03 0.4 0.2 
5. A= 6. A= 
: be | a fe | 
1 1 1 2 1 
2 4 O ge. 3 
A= |5 = 5 .A=|> | 0 
eb 4 1 9 2 
0.7 01 O01 03 01 04 
39.A=|02 0.7 O.1 40.A=|02 04 0.0 
0.1 02 08 0.5 0.5 0.6 


41. Prove that if A is an n x n symmetric matrix, then P’AP is 
symmetric for any n x n matrix P. 


42. Show that the characteristic equation of 


0 1 0 Qos 0 
0 0 1 Qo ee 0 
An : : : . : 
0 0 0 Q 2e 1 
do /a,, a,/a, a,/a, a;/a, —a,-1/A, 


a, # 0, is p(A)=a,A" +a, ,A7 1 +++ + +a,3 + ad? 4 
aA +d) = 0. A is called the companion matrix of the 
polynomial p. 


In Exercises 43 and 44, use the result of Exercise 42 to find the 


companion matrix A of the polynomial and find the eigenvalues 
of A. 


43. p(A) = —9A + 42 
44, p(A) = 189 — 120A 


7? + 2A3 


45. 


47. 


48. 


49. 


50. 


51. 


52. 


53. 
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The characteristic equation of the matrix 


-4 
a-L 
2 2 

is A> — 10A + 24 = 0. Because A? — 10A + 24/, = O, you 


can find powers of A by the process shown below. 


A? = 10A — 241,, A? = 10A? — 24A, 
A* = 10A3 — 24A?,.. . 


Use this process to find the matrices A? and A?. 


ll 


. Repeat Exercise 45 for the matrix 
9 4 -3 
A= |-2 0 6]. 
-1 -4 11 
Let A be ann X n matrix. 
(a) Prove or disprove that an eigenvector of A is also an 
eigenvector of A’. 
(b) Prove or disprove that an eigenvector of A? is also an 
eigenvector of A. 
Let A be an 1 x n matrix. Prove that if Ax = Ax, then x is 
an eigenvector of (A + cl). What is the corresponding 
eigenvalue? 
Let A and B be n x n matrices. Prove that if A is nonsingular, 
then AB is similar to BA. 
(a) Find a symmetric matrix B such that B? = A for the matrix 
Li 
A= : 
1 2 
(b) Generalize the result of part (a) by proving that if A is an 
n Xn symmetric matrix with positive eigenvalues, then 
there exists a symmetric matrix B such that B? = A. 
Find an orthogonal matrix P such that P~'AP is diagonal for the 


matrix 


a= ; | 

bal 
Writing Let A be an nxn idempotent matrix (that is, 
A? = A). Describe the eigenvalues of A. 


Writing The matrix below has an eigenvalue A = 2 of 
multiplicity 4. 
2 a 0 0 
2 b 
dees 0 0 
0 0 ys (6 


0 0 0 2. 

(a) Under what conditions is A diagonalizable? 

(b) Under what conditions does the eigenspace of A = 2 
have dimension 1? 2? 3? 
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54, Determine all x n symmetric matrices that have 0 as their only 
eigenvalue. 


True or False? In Exercises 55 and 56, determine whether each 
statement is true or false. If a statement is true, give a reason or cite 
an appropriate statement from the text. If a statement is false, provide 
an example that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


55. (a) An eigenvector of an n x n matrix A is a nonzero vector 
x in R" such that Ax is a scalar multiple of x. 
(b) Similar matrices may or may not have the same eigenvalues. 
(c) To diagonalize a square matrix A, you need to find an 
invertible matrix P such that P~'AP is diagonal. 


56. (a) An eigenvalue of a matrix A is a scalar A such that 
det(Al — A) = 0. 


(b) An eigenvector may be the zero vector 0. 


(c) A matrix A is orthogonally diagonalizable if there exists an 
orthogonal matrix P such that P~'AP = D is diagonal. 


Population Growth 


In Exercises 57—60, use the age transition matrix A and the age 
distribution vector x, to find the age distribution vectors x, and x;. 
Then find a stable age distribution vector for the population. 


1 heal 
»X, = 
0 100 


| 


a) 


0 1 2 
58. A = 3 x, = 3 
rl 0 32 
0 3 12 300 
59.A=|1 0 O|,x, =| 300 
GC < ® 300 
0 2 2 240 
60.A=|5 0 O|,.x, =| 240 
0 0 0 240 


61. A population has the characteristics listed below. 


(a) A total of 90% of the population survives its first year. Of 
that 90%, 75% survives the second year. The maximum 
life span is 3 years. 


(b) The average number of offspring for each member of the 
population is 4 the first year, 6 the second year, and 2 the 
third year. 


The population now consists of 120 members in each of the 
three age classes. How many members will there be in each age 
class in 1 year? In 2 years? 


62. A population has the characteristics listed below. 


(a) A total of 75% of the population survives its first year. Of 
that 75%, 60% survives the second year. The maximum 
life span is 3 years. 


(b) The average number of offspring for each member of the 
population is 4 the first year, 8 the second year, and 2 the 
third year. 


The population now consists of 120 members in each of the 
three age classes. How many members will there be in each age 
class in 1 year? In 2 years? 


Systems of Linear Differential Equations 
(Calculus) 


In Exercises 63-66, solve the system of first-order linear differen- 
tial equations. 


63. y= y, + 2yy 64. y= 3y, 
y,'=0 y= WA Ie 

65. y,' = y> 66. y,’ = 6y, — y2 + 2y3 
Mw =i = 3y2 — 3 
ys’ = 0 3° = Y3 


Quadratic Forms 


In Exercises 67—70, find the matrix A of the quadratic form associ- 
ated with the equation. In each case, find an orthogonal matrix P 
such that P7AP is diagonal. Sketch the graph of each equation. 

67. x7 + 3xy + y> —-3 =0 

68. x2 — /3xy + 2y?- 10 =0 

69. xy —-2=0 

70. 9x? — 24xy + 16y? — 400x — 300y = 0 
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OrNaiaiwas Projects 


1 Population Growth and Dynamical Systems (I) 


Systems of differential equations often arise in biological applications of population 
growth of various species of animals. These equations are called dynamical systems 
because they describe the changes in a system as functions of time. Suppose that over 
time f you are studying the populations of predator sharks y,(¢) and their small fish 
prey y,(t). One simple model for the relative growths of these populations is 


y, (0) a ay,(t) oF by,(t) Predator 
yy'(t) = cy,(t) + dy,(t) Prey 


where a, b, c, and d are constants that depend on the particular species being studied 
and on factors such as environment, available food, other competing species, and so 
on. Generally, the constants a and d are positive, reflecting the growth rates of the 
individual species. If the species are in a predator-prey relationship, then b > 0 and 
c < 0 indicate that an increase in prey fish y, would cause an increase in y,, whereas 
an increase in the predator sharks y, would cause a decrease in y,. 


Suppose the system of linear differential equations shown below models the popula- 
tions of sharks y,(t) and prey fish y,() with the given initial populations at time t = 0. 


yO) = 0.5y,(t) ar 0.6y,(t) y,(0) = 3S 
y(t) = —04y,(t) + 3.0y,(2) y,(0) = 121 


1. Use the diagonalization techniques of this chapter to find the populations 
y,(t) and y,(t) at any time t > 0. 

2. Interpret the solutions in terms of the long-term population trends for the 
two species. Does one species ultimately disappear? Why or why not? 

3. If you have access to a computer software program or graphing utility, graph 
the solutions y,(t) and y,(¢) over the domain 0 < ft < 3. 

4. Use the explicit solution found in part 1 to explain why the quotient 
y,(t)/y,(t) approaches a limit as f increases. 

5. If you have access to a computer software program or graphing utility that 
can solve differential equations numerically, use it to graph the solution of 
the original system of equations. Does this numerical approximation appear 
to be accurate? 


478 


Chapter 7 Eigenvalues and Eigenvectors 


For Further Reference You can learn more about dynamical systems and popula- 
tion modeling in most books on differential equations. For example, Differential 
Equations and Their Applications, fourth edition, by Martin Braun, Springer-Verlag, 
1993, discusses the theory and applications of systems of linear differential equations. 
An especially interesting application of nonlinear differential equations is given in 
Section 4.10: ““Predator-prey problems; or why the percentage of sharks caught in the 
Mediterranean Sea rose dramatically during World War I.” 


2 The Fibonacci Sequence 


The Fibonacci sequence is named after the Italian mathematician Leonard Fibonacci 
of Pisa (1170-1250). The simplest way to form this sequence is to define the first two 
terms as x, = 1 and x, = 1, and then define the nth term as the sum of its two 
immediate predecessors. That is, 


Xn ~ Xn-1 oP Xn-2° 


So, the third term is 2 = 1 + 1, the fourth term is 3 = 2 + 1, and so on. The 
formula x, = x,—, + x,» is called recursive because the first n — 1 terms must be 
calculated before the nth term can be calculated. Is it possible to find an explicit 
formula for the nth term of the Fibonacci sequence? In this project, you will use 


eigenvalues and diagonalization to derive such a formula. 


1. Use the formula x, = x,_, + x,_, to calculate the first 12 terms in the 
Fibonacci sequence. 
2. Explain how the matrix identity 


|. 1 be a ee ar os 
1 0 Xn-2 Xn- 1 
can be used to generate recursively the Fibonacci sequence. 


2 : xX,]_ 1 = 1 a Xn = 1 Il 
3. Starting with = , Show that A” = , Where A = ; 
26) 1 1 Xn-1 i =@ 


4. Find a matrix P that diagonalizes A. 
5. Derive an explicit formula for the nth term of the Fibonacci sequence. Use 
this formula to calculate x,, x5, and x3. 
6. Use the explicit formula for the nth term of the Fibonacci sequence together 
with a computer or graphing utility to find x), and xo. 
7. Calculate the quotient x,,/x,_, for various large values of n. Does the 
quotient appear to be approaching a fixed number as n tends to infinity? 
8. Determine the limit of x,,/x,,, as n approaches infinity. Do you recognize 
this number? 
For Further Reference You can learn more about Fibonacci numbers in most books 
on number theory. You might find it interesting to look at the Fibonacci Quarterly, 
the official journal of the Fibonacci Association. 
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GUN aes Cumulative Test 


Take this test as you would take a test in class. After you are done, check your work against the 
answers in the back of the book. 


1. 


Determine whether the function T: R? > R?, T(x, y, z) = (2x, x + y) is a linear transfor- 
mation. 


2. Determine whether the function T; M,,—R, T(A) = |A + A’| is a linear transformation. 


Figure 7.8 


10. 


11. 


. Let T: R? > R? be the linear transformation defined by T(v) = Av, where 


1 0 
A= |-1 O}. 
0 0 


Find (a) 7(1, —2) and (b) the preimage of (5, —5, 0). 


. Find the kernel of the linear transformation T: R* > R*, T(x,, X>, 3, X4) = 


(x, — X,X_ — X, 0, x3 + x4). 


. Let T: R*— R? be the linear transformation represented by T(v) = Av, where 


1 1 
AS | : i 

0 -1 0 -I 
Find a basis for (a) the kernel of T and (b) the range of T. (c) Determine the rank and 
nullity of T. 


. Find the standard matrix for the linear transformation represented by 


T(x, y,z) =(x + y,y +z, x — 2). 


. Find the standard matrix A of the linear transformation proj,u: R? > R* that projects an 


arbitrary vector u onto the vector 


a 


as shown in Figure 7.8. Use this matrix to find the images of the vectors (1, 1) and (—2, 2). 


. Find the inverse of the linear transformation T: R? > R? represented by T(x, y) = (x — y, 


2x + y). Verify that (T~! ° T)(3, —2) = (3, —2). 


. Find the matrix of the linear transformation T(x, y) = (y, 2x, x + y) relative to the bases 


B = {(1, 1), (, 0)} for R? and B’ = {(1, 0, 0), (1, 1, 0), (1, 1, 1)} for R?. Use this matrix 
to find the image of the vector (0, 1). 

Let B = {(1, 0), (0, 1)} and B’ = {(1, 1), (1, 2)} be bases for R?. 

(a) Find the matrix A of T: R? > R?, T(x, y) = (x — 2y, x + 4y) relative to the basis B. 
(b) Find the transition matrix P from B’ to B. 

(c) Find the matrix A’ of T relative to the basis B’. 


@) Bnd Awl? bis | >I 


(e) Verify your answer in part (d) by finding [v], and [7(v) ],. 

Find the eigenvalues and the corresponding eigenvectors of the matrix 
1 2 1 

A=|0 3 ile 
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12. 


13. 


14. 


15. 


16. 


17. 


18. 


19. 


20. 


21, 
22. 
23. 
24. 


25. 
26. 
27. 


Find the eigenvalues and the corresponding eigenvectors of the matrix 


i> 1 
A=1|0 1 2 |. 
0 0 1 


Find a nonsingular matrix P such that P~'AP is diagonal if 


1 3 
Az | | 
—1 5 
Find a basis B for R? such that the matrix for 7: R?—R?, T(x, y, z) = (2x — 2z, 


2y — 2z, 3x — 3z) relative to B is diagonal. 
Find an orthogonal matrix P such that PAP diagonalizes the symmetric matrix 


a=[5 al 


Use the Gram-Schmidt orthonormalization process to find an orthogonal matrix P such 
that PAP diagonalizes the symmetric matrix 


0 iL 1 
A= |1 0 1 
1 1 0 


Solve the system of differential equations. 


, 


Ye > i 

yy = 3y, 

Find the matrix of the quadratic form associated with the quadratic equation 
4x? — 8xy + 4y? - 1 =0. 


A population has the characteristics listed below. 


(a) A total of 80% of the population survives its first year. Of that 80%, 40% survives its 
second year. The maximum life span is 3 years. 


(b) The average number of offspring for each member of the population is 3 the first year, 
6 the second year, and 3 the third year. 


The population now consists of 150 members in each of the three age classes. How many 
members will there be in each age class in | year? In 2 years? 


Let A be an n x n matrix. Define the terms eigenvalue and eigenvector of A. How many 
eigenvalues can A have? 

Define an orthogonal matrix and determine the possible values of its determinant. 

Prove that if A is similar to B and A is diagonalizable, then B is diagonalizable. 

Prove that if 0 is an eigenvalue of A, then A is singular. 

Prove that the eigenvectors corresponding to distinct eigenvalues of a symmetric matrix are 
orthogonal. 

Prove that the range of a linear transformation T: V— W is a subspace of W. 

Prove that a linear transformation is one-to-one if and only if its kernel is {0}. 

Find all eigenvalues of A if A? = O. 
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Appendix Mathematical Induction and Other Forms of Proofs Al 


Mathematical Induction and Other Forms of Proofs 


In this appendix you will study some basic strategies for writing mathematical proofs— 
mathematical induction, proof by contradiction, and the use of counterexamples. 


Mathematical Induction 


To see the need for using mathematical induction, study the problem situation in the 
next example. 


SOLUTION 


Sum of Odd Integers 
Use the pattern to propose a formula for the sum of the first n odd integers. 
1=1 
1+3=4 
1+3+5=9 


1+34+5+7= 16 
1l+34+3 4779 = 25 
Notice that the sums on the right are equal to the squares 17, 2”, 3°, 47, and 57. Judging from 
this pattern, you can surmise that the sum of the first n odd integers is n, 


14+34+5+7+---+(2Qn-1) =n’. 


Although this formula is valid, it is important to see that recognizing a pattern and then 
simply jumping to the conclusion that the pattern must be true for all values of n is not a 
logically valid method of proof. There are many examples in which a pattern appears to be 
developing for small values of n and then at some point the pattern fails. One of the most 
famous cases of this was the conjecture by the French mathematician Pierre de Fermat 
(1601-1665), who speculated that all numbers of the form 


F,=2"+1, n=0,1,2,... 


are prime. For n = 0, 1, 2, 3, and 4, the conjecture is true. 


=2 
F,=5 

Fy = 17 
F225] 
F, = 65,537 


The size of the next Fermat number (Fs = 4,294,967,297) is so great that it was 
difficult for Fermat to determine whether it was prime or not. Another well-known 
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mathematician, Leonhard Euler (1707-1783), later found the factorization 
F, = 4,294,967,297 = (641)(6,700,417), 


which proved that F; is not prime and Fermat’s conjecture was false. 

Just because a rule, pattern, or formula seems to work for several values of n, you cannot 
simply decide that it is valid for all values of n without proving it to be so. One legitimate 
method of proof for such conjectures is the Principle of Mathematical Induction. 


Principle of | Let P,, be a statement involving the positive integer n. If 


Mathematical Induction 1. P, is true, and 
2. the truth of P, implies the truth of P,.,, for every positive integer k, then P,, must be 
true for all positive integers n. 


In the next example, the Principle of Mathematical Induction is used to prove the 
conjecture from Example 1. 


EXAMPLE 2| Using Mathematical Induction 


Use mathematical induction to prove that the following formula is valid for all positive 
integers n. 


S,=14+34+5+7+---:+Qn-)YN=n 
SOLUTION Mathematical induction consists of two distinct parts. First, you must show that the formula 
is true when n = 1. 
1. When n = 1, the formula is valid because S$; = 1 = V. 


The second part of mathematical induction has two steps. The first step is to assume the 
formula is valid for some integer k (the induction hypothesis). The second step is to use 
this assumption to prove that the formula is valid for the next integer, k + 1. 


2. Assuming the formula 
SH=1+3 4547 $e++ + Qh 1H 
is true, you must show that the formula 
Sai = K+ 1p 
is true. Notice in the steps shown below that because (2k — 1) is the kth term of the sum, 
[2(k + 1) — 1] is the (k + 1)st term. 
Sig BR IPS +S 7 Fe ee QR = 1) + 2 1) = 1] 
[Po 6 7 oot QR = 1) + e+ 1] 
= S, + (2k + 1) 
=hP+2k+1 S, = k? from induction hypothesis. 
= (k + 1)? 
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Combining the results of parts (1) and (2), you can conclude by mathematical induction that 
the formula is valid for all positive integers n. 


A well-known illustration used to explain why mathematical induction works is the 
unending line of dominoes shown in the figure at the left. If the line actually contains 
infinitely many dominoes, then it is clear that you could not knock the entire line down 
by knocking down only one domino at a time. Suppose, however, it were true that each 
domino would knock down the next one as it fell. Then you could knock them all down 
simply by pushing the first one and starting a chain reaction. 

Mathematical induction works in the same way. If the truth of P, implies the truth of 
P,.,, and if P, is true, then the chain reaction proceeds as follows: 


P, implies P,, 
P, implies P, 
P, implies P,, and so on. 


In the next example you will see the proof of a formula that is often used in calculus. 


EXAMPLE 3| Using Mathematical Induction 


Use mathematical induction to prove the formula for the sum of the first n squares. 


n(n + 1)(2n + 1) 
6 


S,=?+24+37+4+--- - y2 = 


SOLUTION 1. The formula is valid when n = | because 


g. Pe DRO) a) _ 1G) 
6 


Si : 


= 1. 


2. Assuming the formula is true for k, 


Fo Pewee be. igg@o Me Vee) 
6 ° 


you must show that it is true for k + 1, 


(K+ 1k + 1) + 1) e+ 1) 1] Be 1 + DE + 3) 
6 6 


To do this, write S,,, as the sum of S, and the (k + 1)st term, (k + 1)?, as follows. 


Sevt 


Sa PP Pee te eee ee P 
= [Pa 2b a a he ee] a ee IP 
_ kk + 1)(2k + 1) n 

6 


(k + 1)? Induction hypothesis 


_ WK + 2k + 1) + 6K + 1)? 
6 
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EXAMPLE 4 


_ (k + 1)[K(2k + 1) + 6(k + 1)] 
6 
_ k+ 12h + 7k + 6] 
6 
_ K+ 1K + 2)@Kk + 3) 
6 


Combining the results of parts (1) and (2), you can conclude by mathematical induction 
that the formula is valid for all positive integers n. 


Many of the proofs in linear algebra use mathematical induction. Here is an example 
from Chapter 2. 


Using Mathematical Induction in Linear Algebra 


SOLUTION 


If A,, Aj,. . ., A, are invertible matrices, prove the generalization of Theorem 2.9. 


(A,A,A3° : -A,) = A, nes -A3'Az'Ay! 


1. The formula is valid trivially when n = 1 because Aj! = Aj?. 
2. Assuming the formula is valid for k, 


(A;A,A,° °° A,)7! = Agls + + A31AQTAT, 


you must show that it is valid for k + 1. To do this, use Theorem 2.9, which says that 
the inverse of a product of two invertible matrices is the product of their inverses in 
reverse order. 
(AjA,A3° * * ApAgyy) | = [(AA0A3° * ADA! 
= A;,!1,(A,4,43°-° -A,)7! Theorem 2.9 
= Api (Az! - - -A3!A51A47') Induction hypothesis 
= Ag Ag!: + + A3!AQIAq! 


So, the formula is valid for k + 1. 
Combining the results of parts (1) and (2), you can conclude by mathematical 
induction that the formula is valid for all positive integers n. 


Proof by Contradiction 


A second basic strategy for writing a proof is proof by contradiction. In mathematical logic, 
proof by contradiction is described by the following equivalence. 


pimpliesg ifandonlyif not q implies not p. 


EXAMPLE 5 
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One way to prove that g is a true statement is to assume that g is not true. If this leads you 
to a statement that you know is false, then you have proved that g must be true. 

The next example shows how to use proof by contradiction to prove that \/2 is 
irrational. 


Using Proof by Contradiction 


SOLUTION 


EXAMPLE 6 


Prove that /2 is an irrational number. 


Begin by assuming that /2 is not an irrational number. 2 is rational and can be written as 
the quotient of two integers a and b that have no common factor. 


a 
J2 = 7 Assume that \/2 is a rational number. 
a 
2 = 5 Square each side. 
2b = a? Multiply each side by b?. 


This implies that 2 is a factor of a?. So, 2 is also a factor of a, and a can be written as 2c. 


2b? = (2c)? Substitute 2c for a. 
2b? = 4c? Simplify. 
b* = 2c? Divide each side by 2. 
2 is a factor of b?, and it is also a factor of b. So, 2 is a factor of both a and b. But this is 


impossible because a and b have no common factor. It must be impossible that \/2 is a 
rational number. You can conclude that ./2 must be an irrational number. 


Proof by contradiction is not a new technique. The proof in the next example was 
provided by Euclid around 300 B.c. 


Using Proof by Contradiction 


SOLUTION 


A positive integer greater than | is a prime if its only positive factors are | and itself. Prove 
that there are infinitely many prime numbers. 


Assume there are only finitely many primes, p,,p>,...,p,- Consider the number 
N = p\p>: * +p, + 1. This number is either prime or composite. If it is composite, then 
it can be factored as the product of primes. But, none of the primes (p,, P>,. . .,P,,) divide 
evenly into N. N is itself a prime, and you have found a new prime number, which 
contradicts the assumption that there are only n prime numbers. 

It follows that no list of prime numbers is complete. There are infinitely many prime 
numbers. 


You can use proof by contradiction to prove many theorems in linear algebra. On the 
next page is an example from Chapter 3. 
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EXAMPLE 7 


Using Proof by Contradiction in Linear Algebra 


SOLUTION 


EXAMPLE 8 


Let A and B be n x n matrices such that AB is singular. Prove that either A or B is 
singular. 


Assume that neither A nor B is singular. Because you know that a matrix is singular if 
and only if its determinant is zero, det(A) and det(B) are both nonzero real numbers. By 
Theorem 3.5, det(AB) = det(A) det(B). So, det(AB) is not zero because it is a product of two 
nonzero real numbers. But this contradicts that AB is a singular matrix. So, you can conclude 
that the assumption was wrong and that either A or B must be singular. 


Using Counterexamples 
Often you can disprove a statement using a counterexample. For instance, when Euler 


disproved Fermat’s conjecture about prime numbers of the form F, = 22" + 1, n = 0, 
1,2,. . ., he used the counterexample F; = 4,294,967,297, which is not prime. 


Using a Counterexample 


SOLUTION 


EXAMPLE 9 


Use a counterexample to show that the statement is false. 
Every odd number is a prime. 
Certainly, you can list many odd numbers that are prime (3, 5, 7, 1 1), but the statement above 


is not true, because 9 and 15 are odd but they are not prime numbers. The numbers 9 and 15 
are counterexamples. 


Counterexamples can be used to disprove statements in linear algebra, as shown in the 
next example. 


Using a Counterexample 


SOLUTION 


Use a counterexample to show that the statement is false. 


If A and B are square singular matrices of order n, then A + B is a singular matrix of 
order n. 


Let A = F | and B = k i Both A and B are singular of order 2, but 


1 0 
a+B=|) 9 


is the identity matrix of order 2, which is not singular. 
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Exercises 


In Exercises 1-4, use mathematical induction to prove that the formula is valid for all positive 
integers n. 


n(n + 1) 
11t+2+34+---+n=—— 
2 
Pts Piya pe ee 
4 
3.34+74+114+15+--+-+(4n — 1) = n(2n + 1) 


(MOM CeDean 


In Exercises 5 and 6, propose a formula for the sum of the first n terms of the sequence. Then use 
mathematical induction to prove that the formula is valid. 


5, 2!, 22, 23, 24... 
1 1 1 1 

6. ’ ’ Benne 
1-2°2+3°3+4° 4-5 


In Exercises 7 and 8, use mathematical induction to prove the inequality for the indicated integer 
values of n. 


7n!>2", n24 


a ee 


9. Prove that for all integers n > 0, 


8. 


10. (From Chapter 2) Use mathematical induction to prove that 

(A,\A,A3° °° A,)7 = Al: + + ASAZAT, 

assuming thatA,, A,, A,,. . .,A,, are matrices with sizes such that the multiplications are defined. 
11. (From Chapter 3) Use mathematical induction to prove that 

|AA,A3° °° An] = [AiI|Ad|/As] > * 1A, 


where A,, A,, A3,. . ., A,, are square matrices of the same size. 


> 


In Exercises 12-17, use proof by contradiction to prove the statement. 


12. If p is an integer and p? is odd, then p is odd. (Hint: An odd number can be written as 2n + 1, 
where n is an integer.) 
13. If a and bare real numbers anda < b,thena+csb+te. 


14. If a, b, and c are real numbers such that ac = bc andc > 0, thena = b. 


15. If a and bare real numbers and | < a < b, then z > - 


16. If a and b are real numbers and (a + b)? = a? + b?, thena = Oorb = Oora=b=0. 
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17. 
18. 


19. 


20. 


If ais areal number and 0 < a < 1, thena? < a. 


Use proof by contradiction to prove that the sum of a rational number and an irrational number is 
irrational. 


(From Chapter 4) Use proof by contradiction to prove that in a given vector space, the zero vector 
is unique. 


(From Chapter 4) Let S = {u, v} be a linearly independent set. Use proof by contradiction to prove 
that the set {u — v, u + y} is linearly independent. 


In Exercises 21-27, use a counterexample to show that the statement is false. 


21. 
22. 
23. 
24. 


25. 


26. 


27. 


If a and b are real numbers and a < b, then a? < b?. 

The product of two irrational numbers is irrational. 

If a and D are real numbers such that a # 0 and b # 0, then (a + b)? = a3 + DB. 
If fis a polynomial function and f(a) = f(b), then a = b. 


If f and g are differentiable functions and y = f(x)g(x), then “ = fxg (x). 
(From Chapter 2) If A, B, and C are matrices and AC = BC, thenA = B. 


1 
j { ah =: ——— 
(From Chapter 3) If A is a matrix, then det(A~ !) creat 
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ANSWER KEY 25. y 27. y 


0.05x — 0.03y a 
Chapter 1 


Section 1.1 (page 11) 


1. Linear 3. Not linear 5. Not linear 
7.x = 2t 9x=1-s-t 
yor ys 
Z=1 
ii. x, = 5 13. x =3 15. x, = —1 
3 
X= 3 y=" 
z=0 


(b) Inconsistent 


(b) Consistent 


(Cc) x =3 

41 

y= S_ 

@) x=3 

x=4 x=2 _ 4 
y=l gas] a 


5x +y=0) (e) The solutions are 
the same. 
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35. 


37. 


43. 


49. 


55. 


61. 


63. 


65. 


67. 


(a) 4x —8y=9] (b) Consistent 
7 (c) There are infinite 
solutions. 
(d) x =3+2¢ 
yo 
=3 (e) The solutions are 
0.8% — 1.6y = 1.8 consistent. 
x,=-1 39. u = 40 Al. x = -} 
x= =] v = 40 y= -3 
x=7 45. x, = 8 47.x=1 
y=1 x,=7 y=2 
Z=3 
No solution 51. x, = 3 —it 53. No solution 
x,=4t-1 
x3 =t 
x=1 57, x, = —15 59. x = —1.2 
y=0 x, = 40 y = —0.6 
Zs 3 x, = 45 z= 24 
w=2 xp = = 19 
1 
7 5 
4 
yy - 5 
1 
x3 = 2 
x = 6.8813 
y = — 163.3111 
z= —210.2915 
w = —59.2913 
This system must have at least one solution because 


x = y = z = Ois an obvious solution. 
Solution: x = 0 

y=0 

z=0 
This system has exactly one solution. 


This system must have at least one solution because 
xX = y = z = Ois an obvious solution. 


Solution: x = 3; 
y= 3 
z= 


~~ WE 


This system has an infinite number of solutions. 


69. 


71. 


73. 


75. 


77. 


81. 
87. 


89. 


(a) True. You can describe the entire solution set using 
parametric representation. 


ax + by=c 

Choosing y = fas the free variable, the solution is 
cb G 

x = —-——t, y = ft, where ¢ is any real number. 
a a 


(b) False. For example, consider the system 
XH FX HX = 1 
Xj FX, Fxg = 2 
which is an inconsistent system. 
(c) False. A consistent system may have only one 
solution. 
3x, —x,= 4 
—3x, +x, = —4 
(The answer is not unique.) 


ates 
y=-4 
= 2 
a 
_ 1 
oO M1 


s= wie 5. 20 
t 4 


x = cos 0 79. k = —2 

y = sin 6 

Allk # +1 83. k = § 85. k = 1,-2 
(a) Three lines intersecting at one point 


(b) Three coincident lines 
(c) Three lines having no common point 


Answers will vary. (Hint: Choose three different values 
of x and solve the resulting system of linear equations in 
the variables a, b, and c.) 


93. 


The intersection points are all the same. 
x = 39,600 


y = 398 

The graphs are misleading because, while they appear 
parallel, when the equations are solved for y, they have 
slightly different slopes. 


Section 1.2 (page 26) 


21. 


«3%3 3.2x4 5.15 7.4x5 
. Reduced row-echelon form 
. Not in row-echelon form 
. Not in row-echelon form 
x, =0 17,x,= 2 19. x, =1 
xX, = 2 xX, =—-1 X= 1 
x,=-1 x, =0 
x, = —26 23. x = 25. No solution 
x, = 13 y= 
xX,= -7 


27, x = 


33. 


35. 


39. 


43. 


47. 


49. 


51. 


Answer Key ATI 
x 4 29,x,= 4 31. x, = 14 2t 
=-2 xX, = -3 Xo = 2+ 3t 
x,= 2 XxX, =f 
x = 100 + 96t — 3s 
JS 
z= 54+ 52t 
w=t 
x=0 37. x, = 23.5361 + 0.52781 
y=2-A4t xX, = 18.5444 + 4.11114 
z=t xX, = 7.4306 + 2.13897 
X,=t 
y= 2 41.x,= 1 
X= —2 xX, = —2 
x,= 3 x,= 6 
xy = —5 xy = -3 
x,= 1 x, = —4 
X= 3 
x,=0 45. x, = -t 
X= —-t Xx = $ 
x,=t x,=0 
X,=t 
(a) Two equations in two variables 


(b) All real k # —3 

(c) Two equations in three variables 
(d) All real k 

(a)at+tb+c=0 
(b)at+b+c#0 

(c) Not possible 


(a)x=3-6t (b) x=75 - ft 
8,5 20, 13 
i ae Ye gad 
Z=—¢t ZT 
(c)x=3-t (d) Each system has an 
y=-3+t infinite number of 
z=t solutions. 
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57. (a) True. In the notation m x n, mis the number of rows 


59. 
61. 
63. 


65. 


67. 


69. 


of the matrix. So, a 6 x 3 matrix has six rows. 


(b) True. At the top of page 19, the sentence reads, “It 


can be shown that every matrix is row-equivalent to 
a matrix in row-echelon form.” 


(c) False. Consider the row-echelon form 


1 0 0 0 0 

0 1 0 0 1 

0 0 1 0 2 

0 0 0 1 3 
which gives the solution x, = 0, x, = 1, x; = 2, 
and x, = 3. 

(d) True. Theorem 1.1 states that if a homogeneous 
system has fewer equations than variables, then it 
must have an infinite number of solutions. 

ad — be #0 

A= 1,3 

Yes, it is possible: 

x, +x, +x, =0 

x PX Hay = 1 

The rows have been interchanged. The first elementary 

row operation is redundant, so you can just use the 

second and third elementary row operations. 

An inconsistent matrix in row-echelon form would have 

a row consisting of all zeros except for the last entry. 


In the matrix in reduced row-echelon form, there would 
be zeros above any leading ones. 


Section 1.3 (page 38) 


1. 


(a) p(x) = 29 — 18x + 3x? 


b) > 

A 

6+ 

Te, 5 4,5 

Tas fas) 

3-4 

2-4 

a G3, 2) 
ee a oe 
123 4 5 6 


22 


P(x) =7+ ve. — 2007) + 5 3(x — 2007) 


Bis wa 


(b) : 
ta. 12) 


(-1, 5) 3+ 


=1 1 
(2006) (2007) (2008) 


7. y is not a function of x because the x-value of 3 is 


repeated. 
11. p(x) = -3x + 8 


13. p(z) = 249 + 2.7z + 0.05z? (where z = x — 1990) 


Year 2010: p = 323 million 
Year 2020: p = 375 million 


15. (a) ag + a,+ a+ a, = 10,003 


Gy + 3a, + 9a, + 27Ta, = 10,526 
ay + 5a, + 25a, + 125a, = 12,715 
dy + Ta, + 49a, + 343a, = 14,410 


17. 


19, 


21. 


23. 


25. 


29. 


31. 
33. 


(b) p(z) = 11,041.25 — 1606.5z + 613.25z? — 45z3 


(where z = x — 2000) 


No, the profits have increased every year except 
2006 and our model predicts a decrease in 2008. 


This is not a reasonable estimate. 


4 4 
p(x) = er + = 


Tr 8 
3 ~ 9 ~ 0.889 


(Actual value is \/3/2 ~ 0.866.) 


Solve the system: 
P(-1) =a,- a, + a, =0 
p(0) = do = 0 
p(l) = ag + a, + a, = 0 
dy — a, ~ ay — 


sin 


(a) x, =s (b)x,= 0 (x= 
xX, =t x» = 0 X= 
x, = 600 —s x, = 600 x3 = 
X,=s—t y= O xz= 
x; = 500 — ¢ x; = 500 Xs = 
X= 8 X= 0 xe= 
x,=t x,= 0 te 

(a) x; =100+7r (b)x,= 100 (Cc) x, = 
x, = —-100+¢t x, = —100 Xo = 
x3; = 200 + t x3; = 200 x3 = 
xXy=t x4 = 0 X4 = 

i, =0 27. (a) I, = 1 (b) , =0 

L=1 I,=2 h=1 

I, =1 I,=1 I,=1 
1 3 2 

+ 

= 1° 21 (1) 

1 2 4 

x+2 %x-2 (x-2/ 

x=2 

y=2 

A=-4 


35. 


X, +X, + x, = 13 
6x, + x, + 3x, = 46 


X,—- %=0 


Answer Key 


where x, = touchdowns, x, = extra points, 


and x; = field goals 


x, =5 
x, = 4 
x, = 4 


Review Exercises — Chapter 1 (page 4/) 


1. 
5. 
9. 


11. 


17. 
19. 


25. 
27. 
29. 


35. 


41. x= 


47. 


Not linear 3. Linear 

Not linear 7. Linear 

x= -+4+4s-3 

y=s 

Z=t 

=5 13. x = -12 15. 2= 0 

ye y= —8 y= 0 

No solution 

x, =-4 21. x= 0 23. 2x3 

oa 3 y=0 

Row-echelon form (not reduced) 

Not in row-echelon form 

== Bthe= 2 33.25. 5 

_ p22 -_ 

x,=0 z= 3 Zz 1 

x=44+3t 372x=3-2 322x,= 1 

y=5 + 2t y=1+2t x= 4 

z=t Z=t x= =3 

X= 2 

x= 0 43.x=1 45. x = —2t 

y=2-4t y=0 y=t 

Z= z=4 o= 
w= w=0 

x,=0 49. x, = —4t 51.k = +1 
Xy = —ht 


Al3 
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53. (a) b = 2aanda # —3 
(b) b # 2a 
(c) a= —3andb = —-6 

55. Use an elimination method to get both matrices in 
reduced row-echelon form. The two matrices are 
row-equivalent because each is row-equivalent to 


1 0 0 
» it Ol 
0 Oo 1 
i O -=<] <2 2-n 
Od B Bese ed 
7/0 6 0. sss © 
Ot © hase @ 


59. (a) False. See page 3, following Example 2. 
(b) True. See page 5, Example 4(b). 
61. (a) 3x, + 2x, + x, = 59 
By Xe =0 
Xo — xX, =1 
where x, = number of three-point baskets, 
Xx, = number of two-point baskets, 
x; = number of one-point free throws 


(b) x, = 5 
x, = 15 
x, = 14 
1 2 1 
: ~ + 
ere) x-2 (x- 2) 
65. (a) p(x) = 90 — x + Bx? 
(b) A 
25+ 
il (4, 20) 
15+ 
10+ 
5-L@.5) 
(3, 0) 
-— t—}> x 
12 3 4 5 


67. p(x) = 50 + Bx + 5x2 


(First year is represented by x = 0.) 
Fourth-year sales: p(3) = 95 


69. (a) 4% = 80 
a + 4a,+ 16a, = 68 
dy + 80a, + 6400a, = 30 

(b) and (c) ag = 80 

—_ 25 

a, ~ ~8 

| 

ay ~ 32 


So, y = Hx? — Bx + 80. 
(d) The results to (b) and (c) are the same. 


(e) There is precisely one polynomial function of degree 


n — | (or less) that fits n distinct points. 


3 Oe 
= 5 
1, = B 
Chapter 2 
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a 2 =1 
1. @ | | | 3 


0 -1 
@ |: | 
- 3 

3. | 1 9 
ao: ig 

ll -6 

o| 5 3 
-7 0 

3 4 

5. (a) 17 8 
° 9 

6 4 
(14 8 
2 


pe WN ooo 


(c) 


12 
4 
=6 


=2 
8 
10 


11. 


13. 


15. 


17. 


19. 


2 3 3 
©l6 6 3 
2 2 1 
- (a) cy, = —6 (b) cy3 = 29 
~x=3,y=2,z=1 
0 15 = 2, 2 
w i ” 31 Al 
3 -4 
(a) Not defined (b)}10 16 
26 46 
-1 19 
(a) 4 —-27 (b) Not defined 
0 14 
60 72 
—20 —24 
(a) (b) Not defined 
10 12 
| 60 72 
». = 2 5 6 1 8 
0 ey) > =l =3 8 
(a) 6 -8 -Il 4 7 —-9 
5 0 9 2 3 3 
12 1 -7 -8 6 8 
5 2 10 -10 -6 -—-5 
1 8 —13 11 3 3 
7 =13 1 1 3 
3 3 10 2 0 1 
(b) 1 7 6 6 2. => 
1 -4 -7 4 11 3 
1 -8 9 =—2 =11 =! 
2 2 5 2 3 8 
6 —27 10 —2. —21 1 
(c) 1 22 —34 15 37 7 
4 -4 -ll 1 2 -Il 
8 -4 -ll 9 —10 17 
=2. =I, —30 10 3 9 


Answer Key 


8 16 21 -21 -8 28 
15 —-19 20 6 6 —8 
—4 0. =-12 =2 =5 11 
@) 16 —6 12 3 11 6 
20 9 1 —-26 —-6 23 
—-10 —26 3 33 9 —33 
21.3 x4 23. 4x 2 25.3 x2 
27. Not defined, sizes do not match. 

—1 L}|x,|_ [4 

- a ello 
I= [5] 
Xs 8 
=2. =3|[4;|— | 4 
31. | 6 el eae 
= [6] 
X5 6 
1 -2 3] | x, 9 
33. | —1 3 —1}|x,| =| —-6 
2 5 5] Lx 17 
xy 1 
x,|=|-1 
Xs 2 
1 —5 2] |x, —20 
35. | —3 1 -1}|x]= 8 
0 -2 5] Lx —16 
x) =] 
xX,/=] 3 
x3 2 

—5 2 
37. 

3 -il 
39.a=7,b=-4,c=-4,d=} 
4l.w=zx=-y 

1 0 0) 10 0 
43. | 0 4 0 45. 4B =| 0 -12 

) 0 9 

—10 0 
za =| 0 -12 


Al15 


A116 == Answer Key 
47. Proof 49. 2 51. 4 53. Proof 
55. Let A = eo al 

49, Ag 


57. 


59. 
63. 
65. 


67. 


69. 


Then the given matrix equation expands to 


i + a5, ay + i = F "| 
Ay + Ady 0 1] 


ay, + Ay, 
Because a,; + da, = | and a,, + aj, = 0 cannot both 
be true, you can conclude that there is no solution. 


iE al-[2 


(a) A? = 


[a ilm! 


61. Proof 


84 60 30 
42 120 84 

[$1037.50 $1400.00 $1012.50] 

Each entry represents the total profit at each outlet. 

(a) True. On page 51, “. . . for the product of two 
matrices to be defined, the number of columns of the 
first matrix must equal the number of rows of the 
second matrix.” 

(b) True. On page 55, “. . . the system Ax = b is consis- 
tent if and only if b can be expressed as . . . a linear 
combination, where the coefficients of the linear 
combination are a solution of the system.” 


0.75 0.15 0.10)}0.75 0.15 0.10 


0.20 0.60 0.20)/0.20 0.60 0.20 
0.30 0.40 0.30]/0.30 0.40 0.30 


PP = 


0.6225 0.2425 
= 0.33. 0.47 0.20 
0.395 0.405 0.20 


This product represents the changes in party affiliation 
after two elections. 


0.135 


-1l 4] 0 
71.;-1 1] 0 
0 OO! 5 


ma-d!] et] 


(The answer is not unique.) 


i 1 —5 
75.b=1/1|/ +21 0|+0]-1 
2 =] =i 
Section 2.2 (page 70) 
] —19 
1. : | 3. : 
ie a ie =o 
300 
7a) -3 3 
a0 0 
-14 -4 
(c) qa 
ai? <9 
9. le 8 po ui. | 
—S =f. 5 = 
id =A 
13. 15. AC = BC = 
a [T, og] We Ac= ac 
1 
17. Proof 19. 
0 
4 0 16 
23. (a)|2 2 (b) | 8 
| 4 
21 3 
©) 3 | 
> 1 0 
25. (a) | 1 4 2 (b) 
3 1 1 
144 3 -1 
()| 3 1 9 


| 


z 


ll 
Cor WwW 


27. 


29. 


31. 


33. 


35. 


37. 


0 8 -2 0 
4 4 3 0 
Ol go: <a 
2, 1 1 2 
68 26 —10 
26 «4i 3 -l 
®) —10 3 43 
6 —-l 5 10 
29 —-14 5 —-5 
is —14 81 =3 2; 
5 -3 39 —13 
—5 2. =13 13 
(A + B)(A — B) = A? + BA — AB — B’, which is not 


necessarily equal to A? — B because AB is not neces- 
sarily equal to BA. 


(apy? = Brat =| 7 | 


A. =x 

4 0 -4 

(AB)' = BTAT=|10 4 -2 
1 -1 -3 


(a) True. See Theorem 2.1, part 1. 

(b) True. See Theorem 2.3, part 1. 

(c) False. See Theorem 2.6, part 4, or Example 9. 
(d) True. See Example 10. 


(a) a=3andb=—1 


(b)atb=1 
b=1 
a =] 


No solution 


(c)a+b+c=0;a=-cH3b=0>c=0>a=0 
b+c=0 
a +c=0 
(d) a= —3t; lett = l:a 3,b=1,c=1 
b=t 
c= ft 
1 0 0 


Answer Key 


47-55. Proof 57. Skew-symmetric 
59. Symmetric 61. Proof 
1 
63. (a) 3(A + A’) 
41, 42° + * Ay 4; 4) any 
— lf | 4a1 42° + + Gon + 12 Ag an2 
a 2 . . . . . 
any an eee 2 Gan Qn Ayn nn 
2a), Ay + A, ay, + Ay 
_ 1| 4% + yo 2a, Ay, + Any 
2 : : ; 
any + Ain Qn2 a Ady, 2Ann 
1 i 
(b) (A — AT) 
Gy, Aypa+ + + Ay 4, 4, any 
— 1 | 421 %2° ++ Gan | _ | G12 S22 ano 
2 . . . . . 
ant ano ann Gin Ay), nn 
0 412 ~ 491 Qin ~ Ant 
— 1/421 ~ 412 0 st Bn ~ Ann 
: ; : ' 
any i Gin ano Ayn, 0 
(c) Proof 
a1 T 1 ieee 
(d) A = (A — AT) + (A + A) = 
it 7 
0 4 -3 2 1 3 
1 1 
-4 0 -5/+]1 6 5 
i: at 7 1 
2 2 0 7 2 1 
Skew-symmetric Symmetric 


0 1 =f 7 
.@A=|! ob 8=[ | 


(The answer is not unique.) 
(b) Proof 


Section 2.3 (page 84) 


Las=[} Vasa 
0 1 
1 0 0 
3. AB =|0 1 O0|=BA 
0 0 1 


Al7 


A18 


27. 


29. 


33. 


35. 


Answer Key 
7 7 7 3 a 
=3 «il “L-4 -7 
1 = 
E 2 | 11. Singular 
3. =3 2 
=5- 5 A 0 -2 08 
2 7 — 15. | —10 4 44 
i 1 10 =2 =32 
1 0 0 
-} ni 0 19. Singular 
gh dl a 
20 4 5 
—24 7 1 -2 
—10 3 0 -1 
e 7 3 =2 
2) =3 =I 1 
. Singular 
. (x= (b) x = (c) x= -3 
yet vie y=-q 
(a) x, =1 (b) x, = 0 
x, = 1 X= 1 
x,=—-1 xX, = 1 
x, =0 31. x, = 1 
xX, =1 X, = —2 
x, =2 X= 3 
x= 1 x4 = 
xs =0 xs = 1 
Xe = —-2 
(a) * io (b) F 7” 
4 10 5 6 
—31 40 t-3 
e one oe ! ; 
138 56 —84 4 6 
(a) 7 37 26 —T1 (b) "i =2 2 
24 34 3 32 =8 


7 0 34 4-2 3 
(c) %]28 -40 —-14 (d)z]}6 2 -8 
30. 14 —25 1 4 2 
37.x = 39. x = 6 
Pi 
41. 3 1 43. Proof 
4 4 


45. (a) True. See Theorem 2.7. 
(b) True. See Theorem 2.10, part 1. 
(c) False. See Theorem 2.9. 
(d) True. See “Finding the Inverse of a Matrix by 
Gauss-Jordan Elimination,” part 2, page 76. 


47-53. Proof 


55. The sum of two invertible matrices is not necessarily 
invertible. For example, let 


E 1 : 1 
A= and B= F 
0 1 0 -i1 


=) 0 0 2 0 
57.(a)| 0 + 0 (b)/0 3 0 
0 O 4 0 4 
=] 0 
59. (a) Proof (b) H=]-1 0 0) 
0 0 1 
61. A = PDP"! 
No, A is not necessarily equal to D. 
1 0 
a i 3 


Section 2.4 (page 96) 
1. Elementary, multiply Row 2 by 2. 
3. Elementary, add 2 times Row | to Row 2. 
5. Not elementary 
7. Elementary, add —5 times Row 2 to Row 3. 


0 0 1 0 0 1 
9. | 0 1 0 11. | 0 1 0 
1 0 0 1 0 0 


13. 


17. 


21. 


25. 


27 


29. 


0 0 
on mt , 
1 0 1 0 
1 Hl 0 
a | 
0 1 0 1 
ay | 
i 3 0 6 
2 2 0 0 
0 
Le all “alle 2] 
(The answer is not unique.) 
1 1] 1 0) 
a ills ills - 
(The answer is not unique.) 
1 0 O};1 -2 0) 
—1 1 0})0 1 0 
0 0 1/0 0 1 
(The answer is not unique.) 
1 0 0 0} 1 0 0 
QO =] 0 0 |) 0 1 0 
0 0 1 0 || 0 0 2 
0 0 0 1]/ 0 0 0 
1 0 0 0} 1 0 0 
0 1 0 0 |) 0 1 0 
0 0 1 0 || 0 0 1 
0 0 0 -1]/0 0-1 
i 0 0 1} 1 0 0 
0 1 0 0) 0 lL. =3 
0 0 1 0) 0 0 1 
0 0 0 14/0 0 0 
(The answer is not unique.) 
33. (a) True. See “Remark” following 


Elementary Matrix,” page 87. 
(b) False. Multiplication of a matrix by a scalar is not 
a single elementary row operation so it cannot be 
represented by a corresponding elementary matrix. 


oro oeorF 


tN 
arm Rl ae 


- OC SO - OC O 


- COCO 


“Definition of 


35. 


37. 


39, 


43. 


Answer Key A19 


(c) True. See “Definition of Row Equivalence,” page 90. 
(d) True. See Theorem 2.13. 


(a) EA will have two rows interchanged. (The same 
rows are interchanged in E.) 


(b) FE? = I, 
1 —a 0 
—b ab+1 0 
-1l 
a 1 
0 0 = 
c 


> illo al-b ah 


No. For example, 


toy illo] 


(The answer is not unique.) 
1 0 0}|3 0 1 
2 1 0}) 0 1 
—1 1 1} LO 0 2 
(The answer is not unique.) 


1 0 0})2 1 0 
45. (a) 0 1 0} 0 1 = 
=] 2 1] LO 0) 3 
(The answer is not unique.) 
1 3 
(b)y=| 2 Gee] 4 
=5 _s 
3 
47. First, factor the matrix A = LU. Then, for each right- 
hand side b;, solve Ly = b, and Ux = y. 
49. Idempotent 51. Not idempotent 
53. Not idempotent 
55. Case l: b=1,a=0 
Case 2: b = 0,a = any real number 
57-61. Proofs 


Section 2.5 (page 112) 


1. 
5. 


3. Stochastic 


7. Next month: 350 people 
In 2 months: 475 people 


Not stochastic 


Stochastic 


A20 = Answer Key 


9, In 1 month In 2 months 35. y= -+ + 2x 37. y= 1.3 + 0.6x 


Nonsmokers S025 5047 39. y = 0.412x + 3 41. y = —0.5x + 7.5 
Smokers of less than 1 pack/day 2500 2499 43. (a) y = 11,650 — 2400x 


Smokers of more than 1 pack/day 2475 2454 (b) 3490 gallons 


11. Tomorrow: 25 students 13. Proof 45. (a) y = 3.24¢ + 223.5 


In 2 days: 44 students _ 
In 30 days: 40 students CP al 


15. Uncoded: [19 5 12],[12 0 3],[15 14 19], Review Exercises — Chapter 2 (page 115) 

[15 12 9] [4 1 20],[5 4 0] id. =o- 8 
Encoded: —48, 5,31, —6, —6,9, —85, 23, 43, L | e S| 3,114 —10 40 

97,5. 15, 115, 36, 59. 9, —5, —4 fe ne ae 

17. Uncoded: [3 15],[13 5],[0 8], [15 13],[5 0], 4 6 3 

[19 15}, [15 14] 5.10 6 —10 7. 5x+4y= 2 
Encoded: 48, 81, 28, 51, 24, 40, 54, 95, 5, 10, —* ese. yess 

64, 113, 57, 100 

19. HAPPY_NEW_YEAR 2: a iy 4 

—x, + 3x,+ x» =0 
21. ICEBERG_DEAD_AHEAD 2x, — 2x, + 4x, = 2 
23. MEET_ME_TONIGHT_RON 

2 =x 5 

8. 2 3 11. = 

3 2ILy —4 
25.A-'=|-4 2. 3}; 

2-1 -1 a BS Aly 10 
_SEPTEMBER_THE_ELEVENTH_WE_WILL 13.)2 —3 —3)|x,) =| 22 
_ALWAYS_REMEMBER_ 4 -Z 3)1% —2 

Coal Steel 1 0 1 2 3 
5 ae ie | Coal _ bad Coal I5.AT=) 2 1),ATA=] 2 5 —41, 
. 0.8 0.1] Steel 40,000 | Steel =3 2 —-3 -4 13 
8622.0 | Farmer AAT = 14 “a 
29. X = | 4685.0 | Baker —4 5 


3661.4 | Grocer 17. AT=[I 3 -1], ATA = [11] 


y y 
31. (a) ; 33. (a) 7 1 3 -1 
sai (2, 3) AA? = 3 9 —3 
r -1 -3 1 
2: 1 
20 20 10 
I> =1 3 2 
| 19. E i” 21.) 3 -3% -i 
T 1 1 1 
= <5. °=5 | 5 


(b) y= 4+ 3x (b) y 
(c) é (c) 2 


25. 


27 


31 
35 


xy 
x, | = 
X3 
1 
14 
[i 
21 
1 
. {0 
0 
1 
. {0 
0 


=] 
37. 
Ez 


I Gl- ole 


_ 
n 


| 
Ww wry 


1 
42 
2 
21 


| 


MID UIE Ulto 
WI Wile Wire 


29. 


0 Oj;;1 #O 
1 O;;O 1 


0 4]{0O 0 
(The answer is not unique.) 


| 


0 
and 


(The answer is not unique.) 


O}} 1 0 1 
—2)]]0 1 0 
1} 0 0 1 


Hl 


(The answer is not unique.) 


a 1 0 
, and 
1 0 0 


LU) 


(The answer is not unique.) 


0) 0) [1 
9, ; 
2 lo | F 
41. (a) a= —-1 
b=-1 
c= 1 
43. Proof 


(b) Proof 


45. 


illo i 


(The answer is not unique.) 


47. 
49. 


51. 


55. 


N 


65. 


67. 


3. 


Answer Key A21 


x=4,y=1,z=-1 
(a) False. See Theorem 2.1, part 1, page 61. 
(b) True. See Theorem 2.6, part 2, page 68. 


1 
(a) False. The matrix 0 a is not invertible. 


(b) False. See Exercise 55, page 72. 
5455 128.2 


. (a) | 3551 77.6 


7591 178.6 


The first column of the matrix gives the total sales 
for each type of gas and the second column gives the 
profit for each type of gas. 


(b) $384.40 
(a) B=[2 $ 3]  (b) BA = [473.5 588.5] 
(c) The matrix BA represents the numbers of calories 


burned by the 120-pound person and the 150-pound 
person. 


. Not stochastic 


80) 2 68 65 
, Px = _P?X = , PX = 
112 124 127 


110,000 | Region 1 123,125 | Region 1 


. (a) | 100,000] Region2 (b) | 100,000] Region 2 


90,000 | Region 3 76,875 | Region 3 
Uncoded: [15 14],[5 0],[9 6], [0 2],[25 0], 
[12 1],[14 4] 
Encoded: 103, 44, 25, 10, 57, 24, 4, 2, 125, 50, 62, 


25, 78, 32 
7 3 2 
AthsS i; | ALL_SYSTEMS_GO 
=2. =1 ) 
At = 0 1 1]; INVASION_AT_DAWN 
=5.=3. =3 
. .CAN_YOU_HEAR_ ME NOW 
= be aa _ Ee 
0.30 0.10) 133,333 
oe: 5. y= 3-4 


A22 = Answer Key 


77. (a) y = 19 + 14x 


(b) 41.4 kilograms per square kilometer 


79. (a) 1.828x + 30.81 


(b) 1.828x + 30.81 


The models are the same. 


(c) x Actual Estimated 
0 30.37 30.81 
1 32.87 32.64 
2 34.71 34.47 
3 36.59 36.29 
4 38.14 38.12 
5 39.63 39.95 
The estimated values are very close to the actual 
values. 
(d) 49.09 (e) 2011 


81. (a) 0.12x + 1.9 


(b) 0.12x + 1.9 


The models are the same. 


(c) x Actual Estimated 
0 1.8 1.9 
1 2.1 2.0 
2 2.3 2.1 
3 2.4 2.3 
4 2.3 2.4 
5 2.5 25 
The estimated values are close to the actual values. 
(d) 3.1 million (e) 2015 
Chapter 3 
Section 3.1 = (page 130) 
1. 1 i Pe 5. 27 7. —24 

9. 6 11. A27 -— 4A -— 5 

13. (a) M,, = 4 (b) Cy, = 4 
M,, = 3 Ci = = 3 
M,, = 2 Cy, = =2 
My = 1 Cyr = 1 

15. (a) M,, = 23 M1 —8 My, = —22 
M,, = 5 Mi, = —5 M3 = 5 
M,,= 7 3. = —22 M,, = —23 


17. 


19. 
25. 
31. 
33. 
39. 
47. 


(b) C, = 233 Cyh= 8 Ce==22 
Ci=-5 C,=-5 C,= —-5 
Cy, = 7 Cy= 22 Cy, = —23 

(a) 4(—5) + 5(—5) + 6(—5) = —75 

(b) 2(8) + 5(—5) — 3(22) = —75 

—58 21. —30 23. —0.022 

4x —2y —2 27. —168 29. 0 


65,644w + 62,256x + 12,294y — 24,672z 


— 100 35. —43.5 37. — 1098 
329 41. —24 43. 0 45. —30 
(a) False. See “Definition of the Determinant of a 


2 x 2 Matrix,” page 123. 
(b) True. See the first line after “Remark,” page 124. 


(c) False. See “Definitions of Minors and Cofactors of 
a Matrix,” page 124. 


.x=-1,-4 51. x =0,1 

.x=-1,4 5A == 1 tf 

. A= —2,0, or 1 59. 8uv — 1 

. er 63. 1 — Inx 

. Expanding along the first row, the determinant of a 


4 x 4 matrix involves four 3 x 3 determinants. Each of 
these 3 x 3 determinants requires six triple products. So, 
there are 4(6) = 24 quadruple products. 


67. wz — xy 69. wz — xy 
71. xy? — x22 + y22 — xy + x72 — yz 
73. bc? + ca? + ab? — ba? — ac? — cb? 
75. (a) Proof 
x 0 0 d 
=I x 0 Cc 
(6) Q. -=1 x b 
0 Qo = a 
Section 3.2 (page 140) 


1. 


3. 


The first row is 2 times the second row. If one row of a 
matrix is a multiple of another row, then the determinant 
of the matrix is zero. 
The second row consists entirely of zeros. If one row of 
a matrix consists entirely of zeros, then the determinant 
of the matrix is zero. 


11. 


13. 


15. 


17. 


19. 


21. 
27. 
33. 
39. 


41. 
49. 
53. 


55. 


. The second and third columns are interchanged. If two 


columns of a matrix are interchanged, then the determi- 
nant of the matrix changes sign. 


. The first row of the matrix is multiplied by 5. If a row in 


a matrix is multiplied by a scalar, then the determinant 
of the matrix is multiplied by that scalar. 


. A 4 is factored out of the second column and a 3 is 


factored out of the third column. If a column of a matrix 
is multiplied by a scalar, then the determinant of the 
matrix is multiplied by that scalar. 


The matrix is multiplied by 5. If an n x n matrix is 
multiplied by a scalar c, then the determinant of the 
matrix is multiplied by c”. 

—4 times the first row is added to the second row. If a 
scalar multiple of one row of a matrix is added to 
another row, then the determinant of the matrix is 
unchanged. 


A multiple of the first row is added to the second row. If 
a scalar multiple of one row is added to another row, 
then the determinants are equal. 


The second row of the matrix is multiplied by — 1. If a 
row of a matrix is multiplied by a scalar, then the 
determinant is multiplied by that scalar. 

The sixth column is 2 times the first column. If one 


column of a matrix is a multiple of another column, then 
the determinant of the matrix is zero. 


=] 23. 19 25. 28 

17 29. —60 31. 223 

— 1344 35. 136 37. — 1100 
(a) True. See Theorem 3.3, part 1, page 134. 


(b) True. See Theorem 3.3, part 3, page 134. 

(c) True. See Theorem 3.4, part 2, page 136. 

k 43. -1 45. 1 47. Proof 
cos? @ + sin? @ = 1 51. sin? 6 — 1 = —cos’ 6 
Not possible. The determinant is equal to 

cos?.x + sin? x, which cannot equal zero because 
cos*x + sin?x = 1, 

Proof 


Answer Key A23 
Section 3.3 (page 149) 
1. (a) 0 (b) -1 3. (a) 2. (b) —6 
1 + 3 
(c) “sl ()|-1 0. 3 
4 6 
0 2 
(d) 0 (d) —12 
5. (a) 3. (b) 6 
6 a =2 
2 1 0 -1 
lg 4 -3 8 
8 5 -4 5 
(d) 18 
7. —44 9, 54 
11. (a) —2 (b) —2 (c) O 
13. (a) 0 (b) —1 (c) —15 
15. (a) 14 17. (a) 29 19. (a) 22 
(b) 196 (b) 841 (b) 22 
(c) 196 (c) 841 (c) 484 
(d) 56 (d) 232 (d) 88 
() % (©) 35 (e) 35 
21. (a) —115 23. (a) —15 25. (a) 8 
(b) —115 (b) —125 (b) 4 
(c) 13,225 (c) 243 (c) 64 
(d) — 1840 (d) —15 (d) 8 
(©) -Tis (e) -5 (e) 3 
27. Singular 29. Nonsingular 
31. Nonsingular 33. Singular 
35. + 37. -4 39. 4 
41. The solution is not unique because the determinant of 
the coefficient matrix is zero. 
43. The solution is unique because the determinant of the 
coefficient matrix is nonzero. 
45.k = —-1,4 47. k = 24 49. Proof 
0 1 1 0 
sf of am [ho] SRO 
(The answer is not unique.) 
55. Proof 


A24 


57. 


59. 


Answer Key 


No; in general, P~'AP # A. For example, let 


i Oy =§ 3 
p=[s shea ls ah 
3 ) 3: =] 


Ee 
and A = L 
—1 0 


Then you have 


7 —27 -49 
P-1Ap = 
16 29 


The equation |P~'AP| = |A| is true in general because 
|p"! AP| = |P~'||A]|P| 
1 
= |P-PllAl = To Plial = la 


Joa 


(a) False. See Theorem 3.6, page 144. 
(b) True. See Theorem 3.8, page 146. 


(c) True. See “Equivalent Conditions for a Nonsingular 
Matrix,” parts 1 and 2, page 147. 


61. Proof 63. Orthogonal 65. Not orthogonal 
67. Orthogonal 69. Proof 
2 2 1 2 2 1 
3 3 3 3 3 3 
Tl. (a) |-} 53] )I-3 FG] 1 
I _2 2 I _2 2 
3 3 3 3 3 3 
A is orthogonal. 
73. Proof 
Section 3.4 = (page 157) 
fy allel Loh 
0 -—3]L0 0) 
fo all a}-Lel--1 
0 -3 2 —6 2 
1 1 1]f1 2 1 
3. f 1 j 0] =|]0] = 210 
1 1 1} [1 2 1 
1 1 1]; -1 0 = 
: 1 4 O0;}=/0/=0} O 
1 1 1 1 0 1 
1 1 1]/-1 =] —1 
r 1 4 1} = 1;=1) 1 
1 1 1], -1 | —1 


11. 


13. 


15. 


17. 


. (a) W-A-—2=0 


(bh) 2-1 


saeeffferef 
(c) = oye |e a aml 4 


. (a) AX — 2A-3 =0 


(b) 3, 


=] 


(c) A=3:x 


. (a) 2 — 3A — 18 = 0 


oe 


(b) 6, -3 


1 —4 
(c) A=6:x He 3: x 4] 
(a) 2 — 3A*7 -— 4A + 12 =0 (b) 2,3, -—2 
=1 | 
(c) A=2: x= O|;A= 3: x= 1]; 
1 1 
1 
A=-2:x=|-1 
4 
(a) A — 3A*7-A+3=0 (b) =1,.1,.3 
0 —1 
(c) A= 1: x= 1j;A=-l: x= 0 
2 2 
1 
A=3: x =]/0 
2 
Eigenvalues: A = —3, 1 
Eigenvectors: A = —3: x = 1 
=5 
A=1 x-| | 
Eigenvalues: A = 1, 2,3 
Eigenvectors: 
0 1 
A=1: x= 1j;A=2: x=|]0];A=3: x= 
1 1 


Answer Key A25 


19. Eigenvalues: A = 1, —2 7-12 2B z 4 i 
Eigenvectors: 5. adj(A) = 2 3 -5|,A7 = —3 —| 3 
1 1 2 3 =2 2 2 
A=1:x=|05A=-2: x=|0 a 
0 3 7 1 9 =13 
21. Eigenvalues: A = —3, —1, 3,5 7. adj(A) a 
° : = = 2, = 7 a = > 
lle ues y = 12; J 4 2 -9 10 
Eigenvectors: > -1 9 —5 
0 0 
7 1 _B 
A= -3:x= Ol eatiee af 9 9 } 9 
ail 0 7 1 o —t 
0 At = 9 9 9 
$ 49-13 
: : 2 ot og oe 
9 9 9 
A=3:x ao ;A=5:x 0 
0 5 9. Proof 11. Proof 
0 3 
: =2 0 
13. |adj(A)| = | | = -2, 
23. Eigenvalues: A = —2, —1,1,3 —1 ! 
2-1 
Eigenvectors: |A|2-! = ; ‘ = 2 
1 
: 0 15. Proof 
A= 224] ASS], 1.4 = 19.x,= 2 2. x) = i 
0 6 vy = 4 yD 
23. Cramer’s Rule does not apply because the coefficient 
1 1 matrix has a determinant of zero. 
h= Ix 0 :\=3:x 0 25. Cramer’s Rule does not apply because the coefficient 
0 2 matrix has a determinant of zero. 
0 : 27. x, =1 29. x, = 1 31.x,= 0 
25. (a) False. If x is an eigenvector corresponding to A, then | iS , i= -} 
any nonzero multiple of x is also an eigenvector =9 = 3 - tl 
x3 x37 9 37 32 


corresponding to A. See page 153, first paragraph. 
, g ea cats 33. Cramer’s Rule does not apply because the coefficient 


(b) False. If A = a is an eigenvalue of the matrix A, then Antennae aude aaiaaor cere: 


A =a is a solution of the characteristic equation 


|AI — A| = 0. See page 153, second paragraph. 35. x, = —4 37. x, = —1 
i 9, =-— 41. = 
Section 3.5 (page 168) ds oe 
B 4k — 3 4k —- 1 
= —2 1 2 = _ 4? y= _ 
1. adj(A) = | Al= 3 1 sale : X . 1 
=3 1 7 7 The system will be inconsistent if k = 3. 
0 0 0 45. 3 47. 3 
3. adj(A) =|0 —12 —6], A~! does not exist. 49. Collinear 51. Not collinear 


0 4 2 53. 3y — 4x = 0 55. x = —2 


A26 


57. 
61. 
65. 
69. 


71. 
73. 


Answer Key 


7 59, 2 
Not coplanar 63. Coplanar 
4x -10y+3z=27 672x+y+z=0 


Incorrect. The numerator and denominator should be 
interchanged. 


Correct 
(a) 49a + 7b + c = 4380 
64a + 8b + c = 4439 
8la + 9b + c = 4524 
(b) a = 13,b = —136, c = 4695 


(c) 4600 


4300 


(d) The polynomial fits the data exactly. 


Review Exercises — Chapter 3 (page 171) 
1. 10 3. 0 5. 0 
be = 6 9. 1620 11. 82 
13. —64 15.°=1 fe 1 
19. Because the second row is a multiple of the first row, 


the determinant is zero. 


. A —4 has been factored out of the second column and a 


3 has been factored out of the third column. If a column 
of a matrix is multiplied by a scalar, then the determinant 
of the matrix is also multiplied by that scalar. 


23. (a) —1 = (b) —5 (c) E | (d) 5 
25. (a) —12 (b) —1728 (c) 144 (d) —300 
27. (a) —20 (b) —55 
29. ¢ 31. -7 
33. x, = O 35. x, = —3 
X= —} x= -1 
x, = X,= 2 
37. Unique solution 39. Unique solution 


41. 


Not a unique solution 


43. 


45. 


51. 


53. 


55. 
59. 


61. 


65. 


67. 


69. 
73. 
75. 


(a) False. See “Definitions of Minors and Cofactors of 
a Matrix,” page 124. 


(b) False. See Theorem 3.3, part 1, page 134. 
(c) False. See Theorem 3.9, page 148. 


128 47. Proof 49. 0 
-tex=[)] and a=-eix= [77] 
A=7. x= and A= -8: x= 
1 1 
1 0 
A=1: x= /1)/;A=3: x =]1); 
0 0 
0 
and A= 4: x =|0 
1 
—4 57. —uv 


Row reduction is generally preferred for matrices with 
few zeros. For a matrix with many zeros, it is often 
easier to expand along a row or column having many 
Zeros. 


ol 


63. Unique solution: x = 0.6 


y=0.5 
Unique solution: x, = 5 
xX = =5 
x,= 1 
(a) 100a + 10b + c = 308.9 (b) a = 0.0045 
400a + 20b + c = 335.8 b = 2.555 
900a + 30b + c = 363.6 c = 282.9 
(c) 400 


250 


(d) The polynomial fits the data exactly. 

16 71. x—2y= —-4 
9x + 4y — 3z =0 

(a) False. See Theorem 3.11, page 163. 


(b) False. See “Test for Collinear Points in the 
xy-Plane,” page 165. 


Cumulative Test Chapters 1-3 


14. 


17. 


Larson Texts, Inc. * Final pages *Elementary Linear Algebra 6ee 


CYAN 


wwe Nop 


. BA = [13,275.00 


(page 177) 


x, = 2, %, = 3, 4 = -2 

x, Hs—- 2 xy H2+txw,=tLu=s 

S,%,=2t,x%,=t 4k =12 
15,500.00] 

The entries represent the total values (in dollars) of the 

products sent to the two warehouses. 


x, = —25,. Xp 


~x=-3,y=4 
17. 22 «(27 
.ATA=|]22 29 36 
27 36 45 
eat 1 _2 1 
4 8 7 7 
@}, 4 ®]  , 
6 12 7 
1 0 -1 
0 0 1 
3 29 
5 5 5 
0 1|] 1 O}} 1 0) 
[Yoo alle al = - 
1 0} L2 1j/LO —-4 
(The answer is not unique.) 
. (a) 14 (b) —10 (c) —140 (d) u 
. (a) 567 (b) 7 (c) ; (d) 343 
mas 10 ae 
M1 1 1 
-+ -4+ 6 6. a= 1, b= 0,652 
~7 a + (The answer is not 
unique.) 
3x + 2y = 11 18. 16 


MAGENTA YELLOW ~~ BLACK 


Answer Key A27 


=D =2 —=2, 
19. A= =I, il 7 A= =2, 0) : A = 2, -2 
1 1 1 

20. No; proof 21. Proof 22. Proof 


23. (a) A is row-equivalent to B if there exist elementary 
matrices, E,,. . ., £,, such that A = E,. . . E,B. 


(b) Proof 


Chapter 4 


Section 4.1 (page 188) 
1. v = (4,5) 


5+ 
4-> 
3+ 
$4] 1 
; 3D 
t +—+—_+_ ++ > + 
ly) 23-405 
9 
11. y = (-3, 3) 
r 
9 
(-3, 3) 5 
e 
3 4 
v=ju 
i3 * 
2: 
u 
t—+-—+ ++ Y> « 


Short 


A28 


Answer Key 


(b) 
y y 
A A 
4+ at 
1 (4, 2) ‘lig (2, 1) 
ol 2" Pe ee 
'T yr*(2, 1) = T 
+—+—}—}- > x =3¥ 27 
a [123 4 © ot 1 
(c) 
y 
A 
a+ 
Al (2, 1) 
+ e 
v 
+ tv Pe 
2“"( 3) 
pp 
1 2 
19. u — v = (-1,0,4) 
v—u= (1,0, —4) 
21. (6, 12, 6) 23. (4,3, 3) 
25. (a) (b) 


27. 
29. 


31. 


33. 


35. 
39. 
43. 
47. 
49. 


51. 
53. 
55. 


57. 
59. 
63. 


(a) and (b) 
(a) (4, -2, 
(b) (8, 12, 24, 34) 
(c) (—4, 4, 13, 3) 


= 8,4) 


(a) (—9, 3, 2, —3, 6) 

(b) (—2, —18, — 12, 18, 36) 

(c) (11, —6, —4, 6, —3) 

(a) (1, 6, —5, ee, (b) (—1, —8, 10, 0) 
Oe ih=a-) @G4—2A)) 
(4, -4, -3, 2) 37. (4, 8, 18, —2) 
v=ut+w ah 
v= —u 45. (-1 i34 6, §) 
v=u, + 2u, — 3u, 


It is not possible to write v as a linear combination of 

U,, U,, and uy. 

v = 2u, + u, — 2u, + u, — U, 

Su, + 3u, 

(a) True. Two vectors in R” are equal if and only if their 
corresponding components are equal, that is, u = v 
if and only ifu, = v,,U, = V5,. . .,U, = V,. 


v= 5u, — u, + u, + 2u, — 


(b) False. The vector cv is |c| times as long as v and has 
the same direction as v if c is positive and the 
opposite direction if c is negative. 


No 
Answers will vary. 61. Proof 
(a) Add —v to both sides. 


(b) Associative property and additive identity 
(c) Additive inverse 

(d) Commutative property 

(e) Additive identity 


65. 


67. 


69. 
71. 


(a) Additive identity 

(b) Distributive property 
(c) Add —c0 to both sides. 
(d) Additive inverse and associative property 
(e) Additive inverse 

(f) Additive identity 

(a) Additive inverse 

(b) Transitive property 

(c) Add v to both sides. 
(d) Associative property 
(e) Additive inverse 

(f) Additive identity 

No 


You could describe vector subtraction as follows: 


or write subtraction in terms of addition, 
u-v=u+d (-Dv. 


Section 4.2 (page 197) 


1. 


(0, 0, 0, 0) 


5. 0 + Ox + Ox? + 0x3 


7. —(V1, Vo, V3 V4) = (— Vy, —Vo, — V3, — Vy) 


21. 


-|@" a12 ais) =| en ~ 42 a 
44, 4g2— 93 ~ 42; 492—_ a3 


= 2 3) = 3 
» —(p + ax + ax? + a3x°) Ay — AyX — AX” — Axx 
. The set is a vector space. 


. The set is not a vector space. Axiom 1 fails because 


x3 + (—x° + 1) = 1, which is not a third-degree poly- 
nomial. (Axioms 4, 5, and 6 also fail.) 


. The set is not a vector space. Axiom 4 fails. 


. The set is not a vector space. Axiom 6 fails because 


(—1)(x, y) = (—x, —y), which is not in the set when 
x #0. 


The set is a vector space. 


23. 
25. 


27. 
29. 


31. 
33. 


35. 


37. 


Answer Key A29 


The set is a vector space. 


The set is not a vector space. Axiom | fails because 


lo alto altlo a 


which is not singular. 
The set is a vector space. 


(a) The set is not a vector space. Axiom 8 fails because 
(1 + 2), 1) = 3(1, 1) = (G, 1) 
10, 1) + 20,1) = (1, 1) + (2,1) = ©, 2). 

(b) The set is not a vector space. Axiom 2 fails because 
(1, 2) + (2,1) = (, 0) 

(2,1) + (1, 2) = (2, 0). 
(Axioms 4, 5, and 8 also fail.) 

(c) The set is not a vector space. Axiom 6 fails because 
(—1)(1, 1) = (Y—1, Y—1), which is not in R2. 
(Axioms 8 and 9 also fail.) 

Proof 

The set is not a vector space. Axiom 5 fails because 

(1, 1) is the additive identity so (0,0) has no additive 

inverse. (Axioms 7 and 8 also fail.) 

(a) True. See page 191. 

(b) False. See Example 6, page 195. 

(c) False. With standard operations on R?, the additive 
inverse axiom is not satisfied. 

(a) Add —w to both sides. 

(b) Associative property 

(c) Additive inverse 

(d) Additive identity 


39. Proof 41. Proof 
Section 4.3 (page 205) 
1. Because W is nonempty and WC R*, you need 


only check that W is closed under addition and scalar 

multiplication. Given 

(tym, OVE W and 

it follows that 

(x1, X25 X3, 0) + (V1, Ya, V3, 0) 
= (x, + yy, %2 + Yo, %3 + Ys, 0) © W. 

So, for any real number c and (x1, X55 X3, 0) EW, it 

follows that 

C(x), X, X3, 0) = 


(Y1, Yo» 3 0) EW, 


(CX, CX>, CX3, 0) © W. 


A30 


3. 


17. 


19. 
25. 


Answer Key 


Because W is nonempty and W C M,,,, you need only 
check that W is closed under addition and scalar multi- 
plication. Given 
0 ll 0 Al 
Ew d EW, 
bs 0 oe Lbs 0 
it follows that 


0 a, 0 | 0 a+ | 
+ = EW. 
& | ls. 0) b, + b, 0) MA 
So, for any real number c and 


0 a 
= : 
b | W, it follows that 


0 a O ca 
= E 
dy ‘| lo ‘| We 


. Recall from calculus that continuity implies integrability; 


WC. So, because W is nonempty, you need only 
check that W is closed under addition and scalar multi- 
plication. Given continuous functions f, g © W, it 
follows that f + g is continuous and f+ g ©€ W. Also, 
for any real number c and for a continuous function 
Jf © W, cf is continuous. So, cf © W. 


- Not closed under addition: 


(0,0; 1) = 10,0, =1) = (0,0, —2) 
Not closed under scalar multiplication: 
2(0, 0, —1) = (0, 0, —2) 


- Not closed under scalar multiplication: 


V1, 1) = (V2, V2) 


. Not closed under scalar multiplication: (— 1)e* = —e* 


. Not closed under scalar multiplication: 


(—2)(, 1, 1) = (2, —2, —2) 


. Not closed under addition: 


EW Tee 9 
0 0 0 1 0 1 
Not closed under addition: 

(2, 8) + (3, 27) = (5, 35) 

Not closed under scalar multiplication: 
2(3, 27) = (6, 54) 
Not a subspace 


21. Subspace 
27. Subspace 


23. Subspace 


Subspace 29. Not a subspace 


31. 


33. 


35. 


37. 


W is a subspace of R?. (W is nonempty and closed under 
addition and scalar multiplication.) 


W is a subspace of R?. (W is nonempty and closed under 
addition and scalar multiplication.) 

W is not a subspace of R?. 

Not closed under addition: 

(1,1, 1) + (, 1,1) = @, 2, 2) 

Not closed under scalar multiplication: 

2(1, 1,1) = (2, 2,2) 

(a) True. See “Remark,” page 199. 

(b) True. See Theorem 4.6, page 202. 


(c) False. There may be elements of W which are not 
elements of U, or vice-versa. 


39-47. Proof 


Section 4.4 (page 219) 


1. (a) u cannot be written as a linear combination of the 
given vectors. 
(b) v = #(2, -1,3) + 3(5, 0, 4) 
(c) w = 8(2, —1, 3) — 3(5, 0, 4) 
(d) z = 2(2, —1, 3) — (5, 0, 4) 
3. (a) u = —4(2, 0,7) + 3(2, 4,5) + 0(2, —12, 13) 
(b) v cannot be written as a linear combination of the 
given vectors. 
(c) w = —2(2, 0,7) + 4(2, 4, 5) + 0(2, —12, 13) 
(d) z = —4(2, 0,7) + 5(2, 4,5) + 0(2, —12, 13) 
5. S spans R?. 7. S spans R?. 


9. S does not span R?. (It spans a line in R?.) 


11. 
13. 
15. 
19. 
21. 
23. 
27. 
31. 
35. 


S does not span R?. (It spans a line in R?.) 
S does not span R?. (It spans a line in R?.) 
17. S spans R?. 

S does not span R3. (It spans a plane in R?.) 


S spans R?. 


S does not span R?. (It spans a plane in R*.) 
Linearly independent 25. Linearly dependent 
Linearly independent 29. Linearly dependent 
Linearly independent 33. Linearly independent 
(3, 4) — 4(-1, 1) — 4(2, 0) = (0,0), 

(3, 4) = 4(-1, 1) + 5(2, 0) 

(The answer is not unique.) 


iii) = 


. (a) Allt # 1, -2 


6 —-19 
- (a) i |= 34-28 


. Linearly dependent 
47. 
49. 


(1, 1,0) — (0,0, 1) — 0(0, 1, 1) = (0, 0, 0) 
(1, 1, 1) = (1,.1,.0) + (6,0, 1) = 0(0, 1, 1) 

(The answer is not unique.) 

(b) All t #3 


7 
(b) Not a linear combination of A and B 


=). 25 
© | |=-4 +58 


1 -Il 
(d) F | = 0A + 0B 
0 0 


45. Linearly independent 

S does not span P,. 

(a) Any set of three vectors in R* must be linearly 
dependent. 

(b) The second vector is a scalar multiple of the first 
vector. 

(c) The first vector is the zero vector. 


. 5, and S, span the same subspace. 


. (a) False. See “Definition of Linear Dependence and 


Linear Independence,” page 213. 
(b) True. See corollary to Theorem 4.8, page 218. 


55-61. Proof 

63. The theorem requires that only one of the vectors be a 
linear combination of the others. Because (— 1, 0, 2) = 
O(1, 2, 3) — (1, 0, —2), there is no contradiction. 

65. Proof 

67. On [0, 1], 


(x) = |x] =x = 4(3x) 

= 3fi(2) = {fi.f,} dependent 
4 AQ) = 

/ 


Answer Key A31 


On [—1, 1], f, and f, are not multiples of each other. 


For if they were, cf,(x) = f,(x), then c( (3x) = |x|. But if 
x = 1,c = 3, whereas if x = —l,c = —1. 
69. Proof 


Section 4.5 
1. 


(page 230) 
R®: {(1, 0, 0, 0, 0, 0), (0, 1, 0, 0, 0, 0), (0, 0, 1, 0, 0, 0), 
(0, 0, 0, 1, 0, 0), (0, 0, 0, 0, 1, 0), (0, 0, 0, 0, 0, 1)} 


ay Alt 0 0 | E 1 0 °| 

NG -O OC OF LG M@ 0 OF 
0 0 1 O|fO0 0 0 1 
lo 0 O a lo 0 0 al 
0 0 0 OJ] f0 0 0 0 
b 0 0 ob lo 1 0 Hl 
° 0 0 | ° 0 0 ‘} 
0 0 1 OV7lo 0 0 1 


5. Pyrt ly x, X47} 


7. S is linearly dependent. 


9. S is linearly dependent and does not span R?. 


11. 
13. 
15. 
17. 
19. 
21. 
25. 
27. 
29. 
31. 
33. 
35. 
39. 
41. 
45. 
49, 


51. 
55. 


S is linearly dependent and does not span R?. 
S does not span R?. 

S is linearly dependent and does not span R?. 
S does not span R?. 

S is linearly dependent and does not span R?. 
S is linearly dependent. 23. S is linearly dependent. 
S does not span M,j 5. 

S is linearly dependent and does not span M, >. 

The set is a basis for R?. 

The set is not a basis for R?. 

The set is not a basis for R?. 

S is a basis for R?. 37. S is a basis for R?. 
S is not a basis for R?. 
S is a basis for R4. 

S is a basis for P3. 

S is a basis for R?. 

(8, 3, 8) = 2(4, 3, 2) — 
S is not a basis for R?. 
6 57. 1 


43. S is a basis for M, >. 
47. S is not a basis for P3. 


(0, 3, 2) + 3(0, 0, 2) 
53. S is not a basis for R°. 
59. 8 61. 6 


A32 Answer Key 


dim(D, ,) = 3 


65. {(1, 0), (0, 1)}, (0, 0), (1, I}, £0, 1), CD} 
67. {(1, 1), (1, 0)} (The answer is not unique.) 
69. (a) Line through the origin 
(6b) {(2,)} ©l 
71. (a) Line through the origin 
6) {2,1,-)D} ©1 
73. (a) {(2, 1,0, 1), (—1, 0, 1, 0)} 
75. (a) {(0,6, 1, —1)} (b) 1 
77. (a) False. If the dimension of V is n, then every span- 
ning set of V must have at least vectors. 
(b) True. Find a set of n basis vectors in V that will span 
V and add any other vector. 
79. Proof 81. Proof 
83. (a) Basis for S,: {(1, 0, 0), (1, 1, 0)}, dimension = 2 
Basis for S,: {(0, 0, 1), (0, 1, 0)}, dimension = 2 
Basis for S, 1 S,: {(0, 1, 0)}, dimension = 1 
Basis for 5, + S,: {(1, 0,0), (0, 1,0), (0, 0, 1)}, 
dimension = 3 
(b) No, it is not possible. 
85. Proof 


Section 4.6 (page 246) 
1. (a) 2 — (b) {(1, 0), (0, 1) 


© (lolli] 


(b) 2 


3.(a)1 (b) {(1,2,3} © {fi} 
5. (a) 2 (b) {(1, 0,3), (0, 1, -3)} 
1 0 
Co) {[3} Hi 
7.(a)2 ) {(1,0,4), (0, 1,3)} 
1 0 
(c) 4} Ol, 
_2] | 3 
5 5 


11. 


47. 


49. 


42. = 30, 1).1= 
. {(0, 0, 0, 0)}, dim = 0 
ete l—3,2)} 


. (a) Inconsistent 


. (a) 2 (b) {(1, 2, —2, 0), (0, 0, 0, 1)} 
1] [0 
(c) 4] O],] 1 
19) | 8 
7 7 
(a) 5 


(b) {(1, 0, 0, 0, 0), (0, 1, 0, 0, 0), 


(0, 0, 1, 0 een 
17 707 70 1 
O|} | 1] |0 ; 0 
(c) 9] 9],}0],]}1],} 0}, ]0 
; ; ‘ 1] |0 
OJ LI 
wee aaonoua 


{(1, 1, 0), (0, 0, 1)} 


. {(1, 0, —1, 0), (0, 1, 0, 0), (0, 0, 0, 1)} 

. {(1, 0, 0, 0), (0, 1, 0, 0), (0, 0, 1, 0), (0, 0, 0, 1)} 
. {(0, 0)}, dim = 0 

. {(—2, 1, 0), (—3, 0, 1)}, dim = 2 

. {(—3, 0, 1}, dim = 1 


{(—1, 2, 1)}, dim = 1 
1, 1, 1,0)}, dim = 2 


(b) 1 


. (a) {(—3, 0, 1), (2,1,0)} — (b) 2 
. (a) {(-4, -1, 1, 0), (—3, -3,0,1)} ~~) 2 
. (a) {(8, -9, -6,6)} — (b) 1 


. (a) Consistent 


(b) x = (2, —4, 1) + (3,5, 0) 
(b) Not applicable 


. (a) Consistent 


(b) x = (5, 0, —6, —4, 1) + s(—2, 1, 0,0, 0) + 
(1,0, 2, =3, 0) 


Paltol= La] 


51. 
53. 


55. 


57. 
59. 
63. 


65. 


67. 


69. 


Four vectors in R? must be linearly dependent. 
Proof 


1 oO] /0O 1 
- lo if fi 4 

1 O|]/O 1 
- F ob i o| 

1 O|]/0 O 
e lo ob i; Hl 
(b) r (c) r (d) R” 
Answers will vary. 61. Proof 
(a) True. See Theorem 4.13, page 233. 


(b) False. See Theorem 4.17, page 241. 


(a) True. the columns of A become the rows of A’, 
so the columns of A span the same space as the rows 
of A’. 

(b) False. The elementary row operations on A do not 
change linear dependency relationships of the 
columns of A but may change the column space 
of A. 

(a) rank(A) = rank(B) = 3 
nullity((A) =n-r=5-3=2 

(b) Choosing x, and x, as the free variables, 


(a) m (e) R”™ 


KH sot 
X_ = 25 — 3t 
x,=5 
X= St 
x5 =t. 


A basis for the nullspace is 


=1 =] 
2 =3 
1 0 
0 5 
0 1 


(c) {(1, 0, 1, 0, 1), (0, 1, —2, 0, 3), (0, 0, 0, 1, —5)} 
(d) {(—2, 1, 3, 1), (—5, 3, 11, 7), (0, 1, 7, 5)} 

(e) Linearly dependent 

(f) (i) and (iii) 

Proof 71. Proof 


Answer Key 
Section 4.7 (page 260) 
8 : a 
1.| | 3. | 4 5 Al 
1 
1 0 3 
9. |-1 11. |-1 »| 
2 2 
1 2 -3 
2 -1 1 
15. F | 17. 0 : : 
0-3 3 
9 4 
5 5 
19. [ ] 
5 5 
1 1 1 —7 3. 10 
2./3 5 4 23.| 5 -1 -6 
3 6 5 11 —3 —-10 
—24 7 1 -2 
| _ 
25. 0 3 0 1 
—29 7 3 -2 
1 =3 =1 1 
[ 3 5 z 
ee 
3 1 
0-7 2 O -T 
5 9 9 1 21 
27. 4 22 - 4 2 
_3 too 1 1 
4 2 : 4 2 
1 
L&-7 -7 0 a 
tl 1 6 4 
3 3 
29. b 
of E|  [§ | 
. 6 
(c) Verify. (d) ; 
1 1 5 
4 5 1 2 2 4 
31.4) | =—7 =10'. =1 (b)|-4 -i 3 
-2 -2 90 3 1 Ss 
2 2 4 


A33 


A34 Answer Key 


33. 


35. 


43. 


45. 
47. 


al= 


(c) Verify. (d) 


Bln Bo 


mls 
| 
ie) 
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via Sle SIS 


(b) |— 


Fie 

~ 

— 
Win 

an 

Oo 
UIN NIE UIE 

— Ww 
vie alm Bly 
SO ve Bln 
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n 
I 


(c) Verify. (d) 


-—_. +c. «,  «<—— 4 
I 


4 1 0 1 
11 37. ) 39. | 3 41. 2 
1 =D 2 —1 
(a) False. See Theorem 4.20, page 253. 
(b) True. See the discussion following Example 4, 
page 257. 
QP 
If B is the standard basis, then 
[B’: B]) = [Bi => Ti (Bb) 


shows that P~!, the transition matrix from B to B’, is 


Bye’. 
If B’ is the standard basis, then [B’ : B] = [J : B] 


shows that P~!, the transition matrix from B to B’, is B. 


Section 4.8 (page 270) 


- (b), (c), and (d) 

. (b) 7. (b) 
ee 13. 0 
. Linearly independent 


. Linearly dependent 


3. (a), (b), and (d) 
os 2 
15. 2e** 
19. Linearly dependent 
23. Linearly dependent 


-y = C,sinx + C,cosx 
~y=C, + Cysinx + Cj cosx 
. Proof 


. No. For instance, consider y” = 1. Two solutions are 


31. Proof 


x2 
y=yzandy=> 


5) 5) + 1. Their sum is not a solution. 


35. Parabola 37. Ellipse 


I+ e (2, 1) 


9x? + 25y? — 36x — 50y + 61 =0 
45. Hyperbola 
(-3,5) ~ 


i 
-6 “-4 -2 1 
9x? —y24+54x + 10y+55=0 


x?—2x+8y+17=0 


Answer Key A35 


47. Ellipse 49. Hyperbola 61. 
i 1 
=) > Xx 10-- 
-§ -4 -3 -2 -1 + 
ao 8+ 


x2 + 4y2 + 4x + 32y +64=0 
2x? -y?+4x+ 10y—22=0 5) 


51. Parabola 


x? +4x4+ 6y-2=0 


Or? ("2 (2 (yp 67. Proof 69. Proof 
oa _ =i ses 7, -? Review Exercises — Chapter 4 (page 272) 
1. (a) (0, 2,5) 3. (a) (3, 1, 4, 4) 
(b) (2, 0, 4) (b) (0, 4, 4, 2) 
(c) (—2, 2, 1) (c) (3, —3, 0, 2) 
(d) (—5S, 6, 5) (d) (9, —7, 2, 7) 
5. (4, -4, -4) 7. (3, -6,0) 
9. v = 2u, — u, + 3u, 11. v = ju, + gu, + Ou, 
0 0 0 0 
13. O34 =| 0 0 0 0}, 
0 0 0 0 
a a2 a3 14 
A= 49) 472 473 A74 
a3) 439 433 A134 
15. O = (0,0, 0) 


A = (—a,, — a), —a;) 
17. W is a subspace of R?. 
19. W is not a subspace of R?. 
21. W is a subspace of R?. 


A36 = Answer Key 


23. 
25. 


27. 
29. 
31. 
33. 
35. 
37. 
39. 
41. 


43. 


45. 


47. 
49. 
51. 


53. 


59. 


65. 


71. 


73. 


75. 


W is not a subspace of C[—1, 1]. 

(a) W is a subspace of R?. 

(b) W is not a subspace of R?. 

(a) Yes (b) Yes (c) Yes 

(a) No (b) No (c) No 

(a) Yes (b) No (c) No 

S is a basis for P3. 

The set is not a basis for M, ». 

(a) {(—3, 0, 4, 1), (—2, 1, 0, 0)} (b) 2 
(a) {(2, 3, 7, 0), (—1, 0, 0, 1)} (b) 2 


{(8, 5)} 

Rank(A) + nullity(A) = 1 + 1=2 

{(3, 0, 1, 0), (—1, —2, 0, 1)} 

Rank(A) + nullity(A) = 2+ 2=4 

{(4, -2, 1)} 

Rank(A) + nullity(A) = 2+ 1 =3 

(a) 2 — (b) {(1, 0), (0, 1)} 

(a) 1 (b) {(1, —4, 0, 4)} 

(a) 3 (b) {(1, 0, 0), (0, 1, 0), (0, 0, 1)} 


3 2 
=9 ri 
8 1 ¥ 
2 = ‘ 
| 61.) 4 63. 
=a 3 0 
4 1 
ae ~ 1 
3] wl af wf! 
=o 
0 oOo 1 
0 1 0 
1 0 0 


Basis for W: {x, x, x*} 

Basis for U: {(x — 1), x(x — 1), x2(« — 1)} 
Basis for WM U: {x(x — 1), x2(« — 1)} 
No. For example, the set 

{x? + x, x? — x, 1} 


is a basis for P3. 


77. 
79. 
81. 
83. 


85. 


87. 
89. 
91. 
95. 
99. 


103. 


Yes, W is a subspace of V. 

Proof 

Answers will vary. 

(a) True. See discussion above “Definitions of Vector 
Addition and Scalar Multiplication in R”,” 
page 183. 

(b) False. See Theorem 4.3, part 2, page 186. 

(c) True. See “Definition of Vector Space” and the 
discussion following, page 191. 

(a) True. See discussion under “Vectors in R”,” page 
183. 

(b) False. See “Definition of Vector Space,’ part 4, 
page 191. 

(c) True. See discussion following “Summary of 
Important Vector Spaces,” page 194. 

(a) and (d) are solutions. 

(a) is a solution. 

e* 93. —8 


Linearly independent 97. Linearly dependent 


Circle 101. Hyperbola 
y y 
A 
3 a 
2 + 
(-1, 0) 7 
t +—? }> x 
-4 J -2-1 | 2 
—2- 
28) ae 


x2 4+y2—4x+2y-4=0 
x2 -y24+2x-3=0 


Parabola 105. Ellipse 
; 
A 
1+ 
ee a 
-6 -2-1 | 
—2-+ 
a3 
—-4+ 
6,4) (4, -2) -5+ 


2x? — 20x —y + 46 =0 Ax? + y? + 32x 4 4y +63 =0 


Answer Key A37 


43. (a) |\ul| = 13, 45. (a) |u|] = 13, 
Ivll = =17 |v] = 13 
(>) (-§, -#) (b) (3,8) 
(©) (-%, 33) © (-3 -#) 
(d) 140 (d) 0 
(e) 169 (e) 169 
(f) 289 (f) 169 
47. lvl =13  & (-3,-3) 
(c) (—36. 36) =(-3 3) @ 238 
(e) 676 (f) 169 
Chapter 5 49. (a) |jul| = 13, |v] =13 — ) (0, -4. -) 
Section 5.1 (page 290) (c) (0, -3, —#) (d) —169 
1.5 3. 3 5. 3yG (e) 169 (f) 169 
7. (@) au ) Svat () on 51. (a) |lul| = = 0.3202 
(b) (0, 0.7809, 0.6247) 
9. (a) 5 1. (@) V6 13. (a) (-#3, 73) (c) (—0.9223, —0.1153, —0.3689) 
(b) V6 (b) JIT () (3, -73) (d) 0.1113 (e) 1.1756 (f) 0.1025 
(eo) /21 () ¥13 53. (a) |u| = 1.7321, lvl] = 2 
ae « ( . 5 (b) (—0.5, 0.7071, —0.5) 
— 4/38" a (c) (0, —0.5774, —0.8165) 
5 (d) 0 (e) 3 (f) 4 
» (-z 38 Fe Tal 55. (a) |lul] = 3.7417, ||v|| = 3.7417 
17. (a) (4,0,3,3) — () (-4,0, -3, -3) (b) (0.5345, 0, 0.2673, 0.2673, 0.5345, — 0.5345) 
c) (0, —0.5345, — 0.5345, 0.2673, — 0.2673, 0.5345 
19. + 31. (3579,2,/72) . : Ou 14 
a 57. (a) |lul| = 3.7417, ||v|| = 4 
ea = (0. V6 V6 a) (b) (—0.25, 0, 0.25, 0.5, —0.5, 0.25, 0.25, —0.5) 
27. (a) (4,4,3) — (b) (—2, -2, -3) (c) (0.2673, —0.2673, —0.5345, 0.2673, —0.2673, 
(c) (—16, — 16, —12) — 0.2673, 0.5345, — 0.2673) 
20.279 31. 2/3 $9 3/27 qd) -4 (©) 14 (f) 16 
35. (a) —6 37. (a) 0 39. (a) 5 59. |(3, 4) - (2, —3)| < ||, 4)I (2, -3)I 
(b) 25 (b) 6 (b) 50 6= 5/13 
(c) 25 (c) 6 (c) 50 oi, (GC, 1,=2) “1 =3,=2)| 
(d) (-12,18) (0 (d) (0, 10, 25, 20) = [IQ, 1, - 2G, -3, -2)I 
iy =30 (e) 0 (e) 25 2 <2V21 


‘ : ° Tt. fo} 
41. —7 63. 1.713 radians; (98.13°) 65. 1p? (105°) 


A38 = Answer Key 


67. 1.080 radians; (61.87°) Section 5.2 (page 303) 

7 7 1. (a) —33 3. (a) 15 5. (a) —34 
69. — 71. = 73. v = (t,0 

4 2 v= (90) (b) 5 (b) /57 (b) /97 
75. v = (2t, 31) 77. v = (t, 4t, s) (c) 13 (c) 5 (c) 101 
79. v = (r,0, 5, t, w) (d) 2/65 (d) 2/13 (d) 266 
81. Orthogonal 83. Parallel 85. Neither 7. (a) 0 (b) 8/3 (c) JS4ll (d) 3/67 
87. Neither 89. Orthogonal 91. Neither 9. (a) 3 (b) /6 (c) 3 (d) 3 
93. Orthogonal; u - v = 0 

: 16 J 10 2/210 

95. (a) False. See “Definition of Length of a Vector in 11. (a) 1s (b) 5 (c) 15 (d) V2 


R",” page 278. 2 6 
(b) False. See “Definition of Dot Product in R”,” page 13. (a) é ~ 0.736 (b) “30 ~ 0.816 


282. ZG 
97. (a) ||u - v|| is meaningless because u - v is a scalar. (c) ‘5 ge 1.904 


(b) u + (u - vy) is meaningless because u is a vector 
e 2 1 4 
+ = 1, 
(d) — 3 De 1.680 


and u - vis a scalar. 
99. |\(5, 1D] = [4 0] + (4, Dl 


V2 s 4+ V2 15. (2) 0) V2 @ 2 @ 22 
101. Ht, | = M1 1 + 12 of 
Jt fF 49 17. (a) -6 = (b) 35 (c) V7 (d) 3V6 
103. 2, OP = a, — DIP + |G. DP 19. @) —S  ) V9 © V5 @ 3V6 
4 = (/2)2 + (V2)? 21. (a) -4  ) VI (©) /2 (@) 21 
108. (7, 1, -2)IP = 113.4, -2)1P + 4, -3, 0) oe a aS 
a V2)? 4.52 25. Proof 27. Proof 
of 29. Axiom 4 fails, page 293. 
107. (a) O= 7 provided u # Oandv #0 ((0, 1), (0, 1)) = 0, but (0, 1) # 0. 
ss 31. Axiom 4 fails, page 293. 
(6292 WMZeeee ((1, 1), (1, 1) = 0, but (1, 1) # 0. 
= 2 33. Axiom 2 fails, page 293. 
109. (15, —8) and (—15, 8), and (73, —79) and (—73, §) ((1, 0), (1,0) + (1, 0)) = ¢(1, 0), (2, 0)) = 4 
are orthogonal to (8, 15). The answer is not unique. ((1, 0), (1, 0)) + (1, 0), (1,0)) =1+1=2 
(4 : 35. Axiom | fails, page 293. If u = (1, 2) and v = (2, 3), 
111. 6 = cos (2) = 35.26 (u, v) = 3(1)(3) — 2(2) = 5 and 


(v, u) = 3(2)(2) — 3(1) = 9. 


113-117. Proof 
37. 2.103 radians (120.5°) 39. 1.16 radians (66.59°) 


119. Ax = 0 means that the dot product of each row of A 


with the column vector x is zero. So, x is orthogonal 41. = 43. 1.23 radians (70.53°) 
to the row vectors of A. - 
121. Proof 45. . 


47. 


49. 


51. 


53. 


55. 


57. 


59. 


61. 


(a) |<(5, 12), (3, 4))| < [](5, 12)I| 1, 4)I 
63 < (13)(5) 
(b) ||(S, 12) + (3, 4)l| = IG, 12)| + 1G, 4)I| 
8/5 < 13+5 
(a) |(1,0, 4)| + (-5,4, D] < Y17V42 
1< J714 
(b) |l(—4, 4, 5)|| < V17 + 42 
J57 < V17 + /42 
(a) |(2x, 3x? + 1)| S |]2xl| [3x2 + 1 


0 < (2)(YI0) 
(b) |[2x + 3x2 + 1]] s ||2x]] + |]3x? + 1] 


J/14 < 24+ 10 
(a) |O(—3) + 3(1) + 2(4) + 1(3)| = 14/35 
14 < /14/35 
-3 4 
w [3 fl] «vee vs 
J771 < /14+ /35 


(a) |(sin x, cos x)| < ||sin x||||cos ~|| 
0 = (Va)(Vz) 
(b) ||sinx + cos x|| < |lsin x|] + ||cos x|| 
Jigs /mr+ fa 
x,e"| < |[xll lel 
1l< at . VJ 5e - 4 
(b) [le + eX] < Ibll + lle" 
Jive Ji+ JBI 


Because 


(f, 2) -| cos x sin x dx 


7 


(a 


Nar 


il i 
5 sin? xf = 0, 


Ff and g are orthogonal. 


The functions f(x) = x and g(x) = $(5x3 — 3x) are 


orthogonal because 


& ; 
(fg) = [xfer — 3x) dx 


1 Ne 1 } 
=e 4 _ 3,2 ee oe, = 
Al (5x 3x7) dx 5 x | 


=1 


Answer Key 


63. (a) (5,3) — (b) (3,8) 
() > 


(b) (—3, 2) 


65. (a) (1, 1) 
(c) y 


| 2. 3 4 
67. (a) (0,5,-3)  &) (— 7, -14, 9) 
OG Gait) Gy Ogi) 
2 © 
71. proj, f = 0 73. proj, f = 


75. proj, f = 0 


79. (a) False. See the introduction to this section, page 


292. 


(b) True. See paragraph after “Remark,” page 301. 


e—1 


77. proj, f = —sin 2x 


A39 


81. (a) (u, v) = 4(2) + 2(2)(—2) = 0 = wand vare 
orthogonal. 


(b) ‘ u = (4, 2) 


v=(2, -2) 


Not orthogonal in the Euclidean sense 
83-89. Proof 


A403 Answer Key 
Section 5.3 (page 318) 
1. Orthogonal 3. Neither 5. Orthonormal 
7. Orthogonal 9. Orthonormal 11. Orthogonal 
13. Orthonormal 
1 4 4 1 

15. Orthogonal; : ),( ; 

s ( J 0) i oa 

3 V3 3) (2 2) 

17. Orthogonal; ( 3°°3° 3 Plo 0, 5 
19. The set {1, x, x7, x3} is orthogonal because 


21. 


27. 
31. 
33. 


35. 


37. 


39. 


41. 


43. 


45. 


(1, a) = 0,41, x7) = 0, (1, 2°) = 0, 
(x, x7) = 0, (x, x7) = 0, (x7, x7) = 0. 
Furthermore, the set is orthonormal because 


» [lol] = 1, []x?[] = 1, and |[°|] = 1. 
So, {1, x, x7, x7} is an orthonormal basis for P3. 
4./13 we 
B) 2 11 
23. =2 25. | 2 

1V'13 Jio 15 

13 a oo 
{(5, 3), & —3)} 29. {(0, 1), (1, 0)} 
Hana) ae acaletan arma) 
{§, -4 0), 


(3,20), (0,0, 1} 
2 


[6 22) (8 V6 8) (2 
Die we ae cae ee 


10 32 32h 
7° 14° 14 


Jd By 
3° 3 


47. 


49, 


51. 


53. 


55. 


59. 


61. 


63. 


67. 


69. 


(a) True. See “Definitions of Orthogonal and 
Orthonormal Sets,” page 306. 

(b) True. See corollary to Theorem 5.10, page 310. 

(c) False. See “Remark,” page 314. 


[aa T99) (2-50. )] 


{(-2.0.-2.0). (So = 
2° ° 2° P\ 6?” 6? 3 
(Ce ejegee sy) 
57. {x?, x, 1} 


Orthonormal 


1 (2-1), 1 
we V6 
(5-3 ("5.°37)| 


Proof 65. 
1 


(x? — 2x + 1) 


— 


Proof 
1 1 ! 
(eee) (0-FeeA) 
1 1 1 1 
pa ohlega 

N(A) basis: {(3, — 1, 2)} 
N(A‘) basis: {(—1, —1, 1)} 

R(A) basis: {(1, 0, 1), (1, 2, 3)} 
R(AT) basis: {(1, 1, — 1), (0, 2, 1)} 
N(A) basis: {(1, 0, — 1)} 

N(AT) = {(0, 0)} 

R(A) basis: {(1, 1), (0, 1)} = R? 
R(A’) basis: {(1, 0, 1), (1, 1, 1)} 


73. Proof 
Section 5.4 = (page 333) 
1. Not orthogonal 3. Orthogonal 
0 2 
: —1 
5. 1 7. , 
span : span j| 0 
0 1 


9. span 


BI} 
3 
8 
3 


_ 


iB 
3 


17. N(A) basis: {(—3, 0, 1)} 


NAT) = { 


R(A) basis: {(1, 0), (2, 1)} = R? 
R(A’) basis: {(1, 2, 3), (0, 1, 0)} 


(0, 0)} 


0 37. 
2 
3 
11. | 5 
3 
2 
3 
1 39. 
15. |—1 41 
2 


43. 


19. N(A) basis: {(—1, —1, 0, 1), (0, —1, 1, 0)} 
N(A‘) basis: {(— 1, —1, 1, 0), (—1, —2, 0, 1)} 
R(A) basis: {(1, 0, 1, 1), (0, 1, 1, 2)} 


R(A’) basis: {(1, 0, 0, 1), (0, 1, 1, 1)} 


aae[ | 


23. x = 


31. y 
A 
37,2 
cup 
i pat 
27 5 
e 1? e 
(—2, 1) (0,1) (2, 1) 
ome owe 
-iI+ 
33. y=x*>-—x 


45. 
49. 


Answer Key AdA4l 


Advanced Auto Parts: 

S = 2.8591? — 32.8117 + 492.01 + 2234 
2010: S ~ $6732 million 

Auto Zone: 

S = 8.44413 — 105.48t? + 578.6t + 4444 
2010: S ~ $8126 million 


y = 36.022 + 87.0t + 6425 


y = 2.4160? — 36.7417 + 4989.3t + 28,549 
Explanations will vary. 
(a) False. See discussion after Example 2, page 322. 
(b) True. See “Definition of Direct Sum,” page 323. 
(c) True. See discussion preceding Example 7, page 328. 
Proof 47. Proof 
If A has orthonormal columns, then A7A = / and the 
normal equations become 
ATAx = A’b 

x = A’b. 


Section 5.5 = (page 350) 
1 
- 3 1. jxi=-k 3. jxk=i 
=2 25. x= 0 z z 
1 3 
y : y 
1 
-k 
x x 
5.ix k= —j 
=j 


7 (=2-0,=1) 
ti. (= 1, =1,=1) 
15, (=2,3, 1) 


3 6 26 
35. y= 5x? + ox + 3 


x 


9. (—8, —14, 54) 
13. (=1, 12, —2) 
17. (5, —4, —3) 


A42 = Answer Key 


19. (2, —1, -1) 21. (1, -1, —3) 59. (a) g(x) ~ —0.0505 + 1.3122x — 0.41772 
23. (1, -5, -3) Of 
25.1 2.6.75. 29. 2/83 nT gee 
a, 1 33..=1 35. Proof 
37. v6 39, 2 41-49. Proof 
51. (a) g(x) = fk(25 + 11x) i 
(b) 3 


61. (a) g(x) ~ —0.4177x2 + 0.9802 
f A 


0 4.5 
0 


53. (a) g(x) = —0.812x + 0.8383 
(b) 


63. g(x) = 2sinx + sin 2x + = sin 3x 
7 4 
65. g(x) = = + 4cos x + cos 2x + 9 £08 3x 


55. (a) 2(x) ~ 0.1148 + 0.6644x 


(b) 15 l 
2 67. g(x) = —(1 — e?7)(1 + cos x + sin x) 
27 
f 1-—e 47 ‘ 
69. g(x) = Soe © + 8cosx + 4sin x) 
a 2 71. g(x) = (1 + m) — 2sinx — sin 2x — 3 sin 3x 
57. (a) g(x) = 1.5x2 — 0.6x + 0.05 73. g(x) = sin 2x 
(b) y ae 0) = 2s nat, SSE 4 SE) 
si if - 8(a) = 2 sinx + — 3 as 
8 
Review Exercises — Chapter 5 (page 352) 
! 1. (a) /5 3. (a) V6 
— (b) Y17 (b) J14 
a (c) 6 (c) 7 
(d) 10 (d) /6 
5. (a) V6 7. (a) V7 
(b) V3 (b) 7 
(c) —1 (c) 6 


(d) JI dd) V2 


25. 


27. 


29. 


33. 


35. 
37. 


39. 


(in 13) 2 (5,35) 23. (35,2535) 


an 


(a) —2 — (b) —— 


i mor 
l(a @.2,-1)| 
: ze - | + [G.2.-0 
VOT Je Je 
= 2° 4 
Cauchy-Schwarz Inequality: 
I((2, - 1), G2, -1))] 
= [2-3 I 116.2. -9] 
2< /8 /8 ~ 9.969 


(s, 31, 41) 31. (27 — 2s - 


(eva eval] 


{(0, 3, 3), (1,0, 0), (0, & —3)} 
(a) (-1, 4, —2) = 2(0, 2, —2) -_ (1, 0, —2) 


(o5-ahG-e-)} 


2) = 3VI(0, Fe) - 
1 1 


Ji (8 


t48,4) 


() (=1,4.= 


Fi) 


(a) : (b) = 
4 a 
d) {V¥3x, /5(4x2 — 3x)} 


(c) 


Answer Key 


41. ce) = | sf 1 = 2 2 1 = ae 
“1 


= f'n =e de=2f =a 


x x47! 

2 

Ee] ec 

© |(-Feh ese va) 

CE WT LEG AE. 

(The answer is not unique.) 

45. (a) 0 _(b) Orthogonal 
(c) Because (f, g) 


47-53. Proof 


2 
55. span) | — 1 


57. N(A) basis: {(1, 0, —1)} 
N(A™) = {(3, 1, 0)} 
R(A) basis: {(0, 0, 1), (1, —3, 0)} 
R(A’) basis: {(0, 1, 0), (1, 0, 1)} 

59. y = 1.7781? — 5.82t7 + 77.9t + 1603 
2010: y ~ $3578 million 

61. y = 10.61x + 396.4 

63. y = 91.112x? + 365.26x + 315.0 

65. y = 151.692x? — 542.62x + 10,265.4 


67. (—2, —1, 1) 69. i+ j + 2k 
71. Proof 7136 2: 
18 8 3x 3 
: =—x=—2 : =-S+— 
75. 2(x) 5 x 5 77. 2(x) a oe 
y y 
A f 
6+ : 1 


A43 


= 0, it follows that |(f, g)| < || fila. 


> X 


= 
Na> 


A44— Answer Key 


79. y = 0.3274x? — 1.459x + 2.12 


4 


0 
0 


y, 


f() 


81. e(x) = 2 sinx — sin 2x 


83. (a) True. See note following Theorem 5.17, page 338. 


(b) True. See Theorem 3.18, page 339. 
(c) True. See discussion on pages 346 and 347. 


Cumulative Test—Chapters 4 and 5 


1. (a) (3, -7) 
(b) (3, —6) 
(c) (—6, 16) 


y 

A 

1+ 
on Gas ee a 
-1-\v=(1,-2) 78 
—2+ 
47 \w=(2,-5) 
—-5-+ 
-6> eet 
Soe e 
—-8+ 

F 

A 

1+ 
SoS 
“TaN vs(1,-2) 67 
eee 
39) he 
—44+ 
=, 3v = (3, -6) 
-6-+ 
=p 

. 
A 
20 +- 
16 + 


Sav — 4w = (6, 16) 


ae 
N2v = (2, -4) 


fie 
tt x« 


| \4w =(8, —20) 


3. Proof 


(page 359) 


6. Yes 


10. 


12. 


13. 


14. 


15. 


16. 


. (a) A set of vectors {v,,. . 


. (a) A set of vectors {v,,. . 


., V,} is linearly independ- 


ent if the vector equation cjv, +: --+cyv, =90 
has only the trivial solution. 
(b) Linearly dependent 

. The dimension is 6. One basis is 
1 0 0| |0 1 0} |0 0 1 
0 0 O],| 1 0 0],| 0 0 0}, 
0 0 0] LO 0 0} Li 0 0 
0 0 0} | 0 0 0] |0 0 0 
0 1 0|,|0 0 1],|0 0 0 
0 0 0] LO 1 0] LO 0 1 


., V, } ina vector space V is 
a basis for V if the set is linearly independent and 


spans V. 
(b) Yes 
1 
= ; i 
0} 1 11. 6 
=5 
O} L-1 
0) 1 = 
2 0 
-1 -l 
@V/5 Vil © 4 
(d) 1.0723 radians; (61.45°) 
a 
I 
2 2 2 2 
fron (022) (0-24) 


73(—3, 2) 


17. N(A) basis: {(0, 1, —1, 0)} 
N(A’) = — 0, 0)} 


R(A) = 
R(AT on {(0, 1, 1, 0), (— 1, 0, 0, 1), (1, 1, 1, 1)} 
—1 
18. span)| —1 
1 


19-21. Proof 


22. y= 2-2, 


23. (a) 3 
(b) One basis consists of the first three rows of A. 
(c) One basis consists of columns 1, 3, and 4 of A. 


2 —3 —2 
1 0 0 
0 5 3 
® yohel hls (e) No 
0 1 0 
0) 0 1 
(f) No (g) Yes (h) No 
24. Proof 
Chapter 6 
Section 6.1 (page 371) 
1. (a) (-1,7) (b) (11, —8) 
3. (a) (1,5, 4) (b) (5, —6, ft) 
5. (a) (—14, -7) (b) (1, 1, 4) 
7. (a) (0, 2, 1) (b) (—6, 4) 
9. Not linear 11. Linear 13. Not linear 
15. Not linear 17. Linear 19. Linear 


21. 


27. 
33. 
37. 


39. 
41. 


43. 


45. 
47. 
51. 
53. 


57. 


59. 
61. 


63. 


65. 


Answer Key A45 


Linear 23. (3, 11, —8) 25. (0, —6, 8) 
(5, 0, 1) 29, (2, 3, 2) 31. T: ROR? 
T:R5R? 35, T: R2-R? 


(a) (10, 12,4) (6) (— 1,0) 
(c) The system represented by 


1 2 1 
Lal 
=2 4 |- 1 
ap oy" 4 
is inconsistent. 
OCI) ©(=t4,21) 
(a) (0,4/2) (by (2V3 - 2, 2V3 +2) 
5 5/3 
ol 
2 2 
True. D, is a linear transformation and preserves addition 


and scalar multiplication. 


False, because sin 2x # 2 sin x for all x. 


g(x) =r +x4+C 49. 9(x) = —cosx + C 
@-1 7G ©-4 
T(1, 0) = (5,4) 55. x2 — 3x — 5 


7(0, 2) = , -1) 

(a) True. See discussion before “Definition of a Linear 
Transformation,” page 362. 

(b) False, because cos(x, + x,) # cosx, + cos x). 


(c) True. See discussion following Example 10, 
page 370. 


(a) (x, 0) (b) Projection onto the x-axis 
(a) Ge + y), Xe + y)) &) G3) 
(c) Proof (d) Proof 
1 1 1 1 
2 (oe ax + ay 
we=|P EP ]- [ETP] enw 
2 2by ax + ay 
(a) Assume that / and k are not both zero. Because 


T(0, 0) = (0 — h,O0 — k) = (—A, —k) # (0, 0), 

it follows that T is not a linear transformation. 
(b) 7(0, 0) = (—2, 1) 

7(2, —1) = (0, 0) 

T(5, 4) = (3, 5) 


A46 Answer Key 


(c) If Tix, y) = (x —h,y — k) = (x,y), then h =0 
and k = 0, which contradicts the assumption that h 
and k are not both zero. Therefore, T has no fixed 
points. 

67. Let T: R’ > R° be given by T(x, y, z) = (0, 0, 0). Then, 
if {v,,V>,V3} is any set of vectors in R%, the set 
{T(v,), T(v>), T(v3)} = {0, 0, 0} is linearly dependent. 

69-73. Proof 


Section 6.2 (page 385) 


Le 3. {(0, 0, 0, 0)} 
5. {ayx + ayx* + a5x*: dy, do, ay are real} 
7. {dy: do is real} 9. {(0, 0)} 
11. (a) {(0, 0)} 13. (a) {(—4, —2, 1)} 
(b) {(1, 0), (0, 1)} (b) {(1, 0), (0, 1)} 


15. (a) {(0, 0)} (b) {(1, —1, 0), (0, 0, 1)} 
17. (a) {(—1, 1, 1, 0)} 
(b) {(1, 0, —1, 0), (0, 1, —1, 0), (0, 0, 0, 1)} 
19. (a) {(0, 0)} (b) O (c) R? (d) 2 
21. (a) {(0, 0)} (b) O 
(c) {(4s, 4t, s — t): s and ¢ are real} 
(d) 2 
23. (a) {(—11t, 6t, 42): t is real} 
(b) 1 (c) R? (d) 2 
25. (a) {(t, —3f): tis real} (b) 1 
(c) {(3t, t): tis real} (d) 1 
27. (a) {(s + t, s, —2f): s and ¢ are real} 
(b) 2 
(c) {(2t, —2t, t): tis real} 
(d) 1 
29. (a) {(2s — t, t, 4s, —5s, s): s and ft are real} 
(b) 2 
(c) {(7r, 7s, 7t, 8r + 20s + 21): r, s, and f are real} 
(d) 3 


31. Nullity = 1 33. Nullity = 3 
Kernel: a line Kernel: R? 
Range: a plane Range: {(0, 0, 0)} 


35. Nullity = 0 
Kernel: {(0, 0, 0) } 
Range: R? 


37. 


39, 


43. 


45. 
47. 


49, 


51. 


53. 


55. 


Nullity = 2 
Kernel: {(x, y, z): x + 2y + 2z = 0} (plane) 
Range: {(r, 2r, 22), t is real} (line) 


2 41. 4 
Zero Standard Basis 
(a) (0, 0, 0, 0) {(1, 0, 0, 0), (0, 1, 0, 0), 
(0, 0, 1, 0), (0, 0, 0, 1)} 
0 1 0 0) 0 
0 0 1 0 0 
(b) : : : 
0 0 0 1 0 
0 0 0) 0 1 
0 0 1 | 0 O}| [0 O 
(c) 
0 0 0) al 1 orto 1 
(d) p(x) = 0 { 1, 5.07; 9° } 


(e) (0, 0, 0, 0, 0) {(1, 0, 0, 0, 0), (0, 1, 0, 0, 0), 
(0, 0, 1, 0, 0), (0, 0, 0, 1, 0)} 

The set of constant functions: p(x) = dy 

(a) Rank = 1, nullity = 2 

(b) {(1,,0, =2), C1, 2,0)} 


Because |A| = —1 #0, the homogeneous equation 

Ax = 0 has only the trivial solution. So, ker(T) = 

{(0,0)} and T is one-to-one (by Theorem 6.6). 

Furthermore, because 

rank(T) = dim(R?) — nullity(7) 
=2-0=2 = dim(R’) 

T is onto (by Theorem 6.7). 

Because |A| = —1 #0, the homogeneous equation 

Ax = 0 has only the trivial solution. So, ker(T) = 

{(0,0,0)} and T is one-to-one (by Theorem 6.6). 

Furthermore, because 

rank(T) = dim(R3) — nullity(7) 
=3-—0=3 = dim(R’) 

T is onto (by Theorem 6.7). 

(a) False. See “Definition of Kernel of a Linear 

Transformation,” page 374. 

(b) False. See Theorem 6.4, page 378. 

(c) True. See discussion before Theorem 6.6, page 382. 

(d) True. See discussion before “Definition of 

Isomor-phism,” page 384. 


(a) Rank =n (b) Rank <n 


Answer Key A47 


57. mn = jk 59. Proof 2: <2, 
61. Although they are not the same, they have the same a an? 
dimension (4) and are isomorphic. 21. (a) J2 J2 (b) (-4V2, 0) 
Section 6.3 (page 397) ; On 2 
i 2 aie (c) y 
1 8 3 lL = 
—4 1 (4, 4) 
1 1 0O 
0 —2 3 2 
5 1 -1l O 7. Tv) Vv 
4 0 Ii ee reer inal : 
=] 0 | =6\-4 -2 2 4 
0 0 0 0 (-4V2,0)_ 
0 0 0 0 
9. 0 0 0 0 11. (35, —7) 1 3 
0 0 0 0 2 2. 
23. (a) (b) (3 + J3,1- 2) 
13. (0, 6, 6, —6) 15. (0, 0) we ft - - 
=] 2 2 
17. (a) 4 
os (@) » 
2. es 1,2 
(b) (—3, -4) mes 
- 4 | (iswv3 2-08 
142/73 2-V3 
+ a9 Lf 
all —60° 
th T\v) 7 
i i i i i i { a f t ~ x 
"A ia T 7] t 4 T H b> x 1 2 
TWv)/ 7 0 0 
(3-4) 1 25. (a)}0 1 Of]  (b) G,2,-2) 
= 0 
19. (a) 0 | 
ib) (<2, = 3) 
(c) y 
1+ 
t—t}-+e-+- +--+ x 
-3-2-1/\\1 2 3 
Tw) /, J v 1 0 0 


27. (a) |}O —I1 0 (b) (1, —2, -1) 
0 0 1 


A48 Answer Key 


(c) 2 3 =I 9 
35. (a) |3 0 -2 (b) | 5 
2 -1 1 —1 
1 =1 0 0 1 
0 0 1 0 1 
| 7.@/, 5 9 a) Ol, 
Me, a 0 0 0 1 =] 
2 2 ws 1 
29. (a) 1 V3 o) ( 5 -1, V3 +3) 4 =| ° “sa=[3 | 
2 2 oe 
0 0 0 0 0 
(ce) ¥ 41.A=]1 0 0|,A’ =] 1 0 0 
A Jd l 
zi (G-1v3+3) 0 0 0 0 0 0 
of Tv) - wit a 5 3 2 
is (1, 2) a.a=|—) 5p 4 = 4 -3 1 
Ir fy a2 $3: -—1 
i i i >X 45. T'(x, y) = (: = y — 
i 2 4 af D 
9 3 a7, Ta te) = ie SR oy a Fe) 
31. (a) E iy | (b) (F, a) 49. T is not invertible. 51. T is not invertible. 
(c) y : , 575 
(1, 4) 55. T (21, X, X 4) X4) = (x, + 2x5, Xp, X4y Xz — Xq) 
57. (9, 5, 4) 59. (—1,5) 
61. (2, —4, —3, 3) 63. (9, 16, —20) 
; a ) 0 0 0 0 1 0 0 
T(v)_,»\10" 10 1 0 0 0 0 
—T elo 1 0 lo. 0. a: 4 
-1 2 3 
i 0 0 1 0 oO oO 1 
33. (a) F () (‘2 -¥) 69. 3 — 2e* — 2xe* 
5 0 0 0 0 
(c) : (1,4) 1 0 0 0 
4 @ 1 a 43 
at ft 71. (a) | 0 5 0 0 (b) 6x — x? + Gxt 
al ee 7 0 0 4 0 
i ee aad oe 0 @ 
t—+-— +++} > x 
-1 ‘34 5 73. (a) True. See discussion under “Composition of Linear 
-24T(v) “ Transformations,” pages 390-391. 
=s (8. -8) (b) False. See Example 3, page 392. 


(c) False. See Theorem 6.12, page 393. 


oa oOo 2 oO: = 


0) 
77. Proof 


79. Sometimes it is preferable to use a nonstandard basis. 
For example, some linear transformations have diagonal 
matrix representations relative to a nonstandard basis. 


Section 6.4 


1. (a) A’ 


(b) A’ 


3. (a) A’ 


(b) A’ 


5. (a) A’ 


(b) A’ 


7. (a) A’ 


oOo oo co =} oo Oo 


(page 405) 


o. = oS -& oO: oS 


el 
WwW Wie 


NI NIE VIE wie wie us| 


WIN Ale Win 


Oo oO oc Oo - © 


| 


oO oOo —} © © © 


wie © 
_——— | 
OR wis —— 
—S | 
| 
me N 


Wo Lope 


——E | 


or | 
Nie NI Nl 


— 
— 
So 


WIE wip 


ian) 
bop nie Ne 


WIN WIoo Wie 


oor 


bet Op OS 2S OS 


_ 


=] 


Answer Key A49 


2 1 1 

30 °°3 3/}/1 —-1 2 
b)A’=1-5 § «51/2 «Ls 

I i 1 1 2 1 

3: 3 3 

1 0 1 

0 2 2 

1 2 0 
x@[§ 3] @th=|_i}tb=|_4] 


1 sh 
2, 2 2 
We} 5-3; 3 
1 ll ill 
2. 2. 2. 
1 2 
(b) Lv], — 0}, [T(v) |p =) 
—| —2 
1 0 0 1 1 
@A=Ha|0 2 OP Te=lt O° FT 
0 0 3 0 1 1 
1 
(d)| 0 
—3 
5 2 
13. (a) k | 
3 5 
0) fvle=|_}} [rove = [5] 
1 1 
J] =2 4 
© a’=| per- —_ 
278 2 3 
—| 
| ;| 
15. Proof 17. Proof 19. I 


A50 = = Answer Key 


21-27. Proof 13. (a) Vertical shear 
29. The matrix for / relative to B and B’ is the square matrix (b) ‘| 
whose columns are the coordinates of v,,...,V, 3+ 
relative to the standard basis. The matrix for J relative to ots ae 
B, or relative to B’, is the identity matrix. 27 ; 
31. (a) True. See discussion, page 399-400, and note that it t 
A’ = P7'AP = PA’P! = PP'APP!=A. @ (x, y) 
(b) False. Unless it is a diagonal matrix; see Example 5, ; : : mos 
pages 403-404. 
‘ 15. ‘eta 1 17. {(t, t): ti 1 
Section 6.5 (page 413) 10 a i 7 a a > = is ; 
. {(t, 0): tis rea . {(t, 0): tis rea 
1. (a) G,=5) (b) (2, 1) (c) (a, 0) ‘i : A : 
(@) (0,-b) =) (-e,-d) (fg) oS 4 
3. (a) (1, 0) (b) (3, - 1) (c) (0, a) (3 : 
(d) (b, 0) (e) (d, —c) (2,7) e ! : 
5. (a) (y, x) (b) Reflection in the line y = x 
7. (a) Vertical contraction 
() |} O-) (.-1 oT re 
4(9) (5.0) 
gy 27. 29, y 
o ; -1,2 
(x, 5 ) 2+ ( ) 2 
(2, 1) (3, 1) 
> XxX 1 
} }—> x 
9. (a) Horizontal expansion : : . ih 9) = 
) -1+ 2 = 
©) ft @y) _. Gx) = 
4 e-- > --+2 
3 31 y 33. ‘ 
2 1) G0) 7 
1 (2, 2) (3, 2) 
1 
> x 
x 
11. (a) Horizontal shear 1 
(b) » 
(x + 3y, y) 


> xX 


39. 


41. 
43. 
45. 
47. 


49. 


nn 
Oe 


(12, 3) 


(0, 0) 


(12, 0) 


2 4 6 8 10 12 2 4 6 8 10 12 


T(1, 0) = (2, 0), T(O, 1) = (0, 3), T(2, 2) = (4, 6) 


(4, 6) 


> xX 


po 
i 
= 12 3 4°55 


Horizontal expansion 


Reflection in the line y = x 
Reflection in the x-axis followed by a vertical expansion 
Vertical shear followed by a horizontal expansion 
v3 1 1 9 ¥3 

2 2 2 2 

i Ae Sl.) 0 1 0 

2 2 8 et 

0 0 1 2 2 


. (V3 =1)/2, (V3 + 1)/2, 1)) 
A 9/8) 2; 1,(1=/3)/2)) 


57. 
61. 


63. 


Answer Key A51 


90° about the x-axis 59. 180° about the y-axis 


90° about the z-axis 
0 1 0 
0 ee | 
—1 0 0 
Line segment from (0, 0, 0) to (1, — 1, — 1) 
Ie be a3 
4 4 2 
1 a3 4 
2 2 
a2 33 1 
4 °4 2 


Line segment from (0, 0, 0) to 


((3V3 — 1)/4, (1 + ¥3)/2, (V3 — 1)/4)) 


Review Exercises — Chapter 6 (page 416) 


1. 
3. 


5. 


9. 


11. 


25. 


(a) (2, —4) (b) (4, 4) 
(a) (0, —1, 7) (b) {(t — 3,5 — 1,2): tis real.)} 
Linear, - a 7. Linear, = 3 
Not linear 
1 -l 0 
Linear, 0) 1 -l 
—] 0 1 
T(1, 1) = (3,5), 70, 1) = (1, 1) 
7(0, —1) = (-1, -2) 
A=] 
B= ie 360 —sin ‘| 
~ | sin 30 cos 36 
. (a) T: R? > R? (b) (3, — 12) 
(c) {(-3, 3 = 26 t): tis real} 
. (a) T.R7R'(b) 5 
(c) {(4 — t,t): tis real} 
(a) T: R27 R? 27. (a) T: R? > R? 
(b) (—2, —4, —5) (b) (8, 10, 4) 
(c) (2,2) © U,=}) 


A52 


29. 


Answer Key 


(a) {(-2, 1, 0, 0), (2, 0, 1, -2)} 
(b) {(5, 0, 4), (0, 5, 8)} 
( 


31. (a) { 1, =1, 1)} (b) {(, 0, 1), (0, 1, —1)} 
33. (a) {(0, 0)} (b) {(1, 0, 3), (0, 1, -3)f 
(c) Rank = 2 (d) Nullity = 0 
3. (= 3,31) (6) {(1, 0, =1), (0,.1,.2)} 
(c) Rank = 2 (d) Nullity = 1 
37. 3 39. 2 
1 
a. =|? ipa = 2 © 
_ |cos@ —sin 6 Sie. cos @ sin@ 
43. a = [8 ee. = [pee oy 
45. T has no inverse. 47. T has no inverse. 
0 0) 0 
49. A=|0 1 ofa’ =|) 1 
0 1 0 
51. Y 
A 
* 700, 3) 
(-3,5) 6+ (3;.5) 
y Nd (5, 3) 
(-5,3) 27 
eee saever 
-6 -4 el (3,0) 6 
53. (a) One-to-one (b) Onto (c) Invertible 
55. (a) One-to-one (b) Onto (c) Invertible 


57. 


(0, 1, 1) 


59 Al = i A 
i. =i 


61. 


63. Answers will vary. 
67. (a) Proof 
(c) {1 —x,1 -— x7,1 — +} 


0 0 0 
@]O 5 § (b) Answers will vary. 
0 2 3 (c) Answers will vary. 


65. Proof 
(b) Rank = 1, nullity = 3 


69. Ker(T) = {v: (v, Vo) = OF 


Range = R 
Rank = | 
Nullity = dim(V) — 1 
71. mn = pq 
73. (a) Vertical expansion 
b y 
- 4 o 2Y) 
(x, y) 
> xX 
75. (a) Vertical shear 
b y 
(b) A @ (x, y + 3x) 
| 9) 
> xX 


77. (a) Horizontal shear 
(b) » 


A 


p= * 2y, y) 


> xX 


mal 
(3, 1) 
1+ (0, 0) 
Za {> x 
(1, 0) 3 


Answer Key A53 


83. Reflection in the line y = x followed by a horizontal Chapter 7 
expansion Saas 
J2/2 ~ 3/2 0 ection /. (page 432) 
wn an alvin Lf) aL 91/9] =-af9 
0 0 1 
c 1 yi of. 1 
1 0 0 3. =0 =32 
ht a8] fee ene 
0 Y3/2 1/2 2 2 11 1 
(.(-1 = va2(-va-+ 107 ie a aa 
J3/2, -1/4 3/4 
89.| 1/2 3/4 -3/4 2 2 1 1 1 
0 19/3/72 1/2 O -1 2]|-1})=-1]/-1], 
Veils -V2/2— 3/4 2 a 2 . 
91. | /6/4 (22 +f2/4 2 3 115 5 
—1/2 O. 3/3/2 0-1 2}/1/=3/1 
93. (0,0, 0), ~2, *,0), (0, v2, 0) ee ; 
BENE EEN ce Bae A PNR Mei ange Oo 1 of 1 
710 O (140)—4)1 
y 2 2. f2 
(-2 - 0), (0, 0, 1), (2 “9? ) 1 0 0 1 1 
7 /2 1 Cc] _ c 
0, V2, 0,(-2, 3° ) on) fF | {| of _f| 
1 l][c 2c Cc 
b - 7 
95. (0, 0, 0), (1, 0, 0), (1 vs 7) (0 _ 7) (®) E ll] Io. | 
11. (a) No (b) Yes (c) Yes (d) No 
0, -2 v3) ss v3) 13. (a) Yes (b) No. (©) Yes__—(d) ‘Yes 
a2 ae 15. (a) AA — 7) = 0 17. (a) 227 -4+=0 
e —s . 4 aa 
(E84) (6 tt Lt) (b) A = 0, (1,2) b) A= 4) 
4=7,G,-1) d= 3,3, 1) 


97. (a) False. See “Elementary Matrices for Linear 19. (a) (A— 2)(A — 3)A- 1) =0 
Transformations in the Plane,’ page 407. (b) A = 1, (1,2, -1); A = 2, (1, 0, 0); A = 3, (0, 1,0) 


- (a) (A 2)A — 4)(A - 1) = 0 
(b) A = 4, (7, —4, 2); A = 2, (1, 0, 0); 


(b) True. See “Elementary Matrices for Linear 1 
Transformations in the Plane,’ page 407. 


(c) True. See discussion following Example 4, page 411. d= 1,(-1, 1,1) 
99, (a) False. See “Remark,” page 364. 23. (a) (A + 3)(A — 3)? = 
(b) False. See Theorem 6.7, page 383. (b) A = —3, (1, 1, 3); A = 3, (1, 0, — 1), (1, 1, 0) 


(c) True. See discussion following Example 5, page 404. 


A54 


25. 


27. 


29. 
35. 
41. 


45. 
49. 


51. 
53. 


55. 
59. 
61. 


63. 
67. 


69. 


71. 


73. 


Answer Key 


(a) (A — 4)(A — 6)(A + 2) = 0 

(b) A = —2, (3, 2, 0); A = 4, (5, — 10, —2) 
A = 6, (1, —2, 0) 

(a) A(A — 3)(A — 2) = 

(b) A = 2, (1,0, 0, 0), (0, 1, 0, 0); 
dA = 3, (0, 0, 3, 4); A = 0, (0, 0, 0, 1) 


A=-2,1 31.A=5,5 33A=4,-3,3 
A= -1,4,4 37. 4 = 0,3 39. A = 0, 0, 0, 21 
— 6A + 8 43. A> — 7A + 12 
M-—2A7-At+2 47. 8 — 5A? + 15A — 27 
Determinant 

Exercise Trace of A of A 

15 7 0 

17 0 = 7 

19 6 6 

21 i] 8 

23 3 =i 

25 8 —48 

27 7 0 
Proof 
Assume that A is an eigenvalue of A, with corresponding 


eigenvector x. Because A is invertible (from Exercise 
52), A # 0. Then, Ax = Ax implies that x = A~'Ax = 
A7~!Ax = AA7~!x, which in turn implies that (1/A)x = 
A~'!x. So, x is an eigenvector of A~'!, and its corre- 
sponding eigenvalue is 1/A. 


Proof 57. Proof 
a=0,d=lora=1,d=0 
(a) False. 


(b) True. See discussion before Theorem 7.1, page 424. 
(c) True. See Theorem 7.2, page 426. 
Dim = 3 65. Dim = 1 
,_ a, 
Tle) = “fe'] = et = He’ 
x 


A= -2,3+ 2x,A = 4, -5 + 10x + 2x7; 
A = 6, -1 + 2x 


v=o. oe iba=3.] 1 | 
“El OV LO =L/P “L=2 0 


The only possible eigenvalue is 0. 


75. 
Section 7.2 


1. 


11. 


15. 


17. 
19. 


21. 


23. 


25. 


27. 


Proof 


(page 444) 


1 -4 1 
rely powell 
=| 3 0 -2 


1 4 
Pl=) LP tap =| > a 
5 5 
j=3 1 . @ « 
P'=| 0 4 O|P'AP=|0 3. O 
af 0 oO -1 
i 3 
1 “2 2 4 0 0 
.P1=|0 4 -3|,P'AP=|0 2. 0 
0 0 1 09 0 3 


. There is only one eigenvalue, A = 0, and the dimension 


of its eigenspace is 1. The matrix is not diagonalizable. 


There is only one eigenvalue, A = 1, and the dimension 
of its eigenspace is 1. The matrix is not diagonalizable. 


. There are two eigenvalues, | and 2. The dimension of 


the eigenspace for the repeated eigenvalue | is 1. The 
matrix is not diagonalizable. 

There are two repeated eigenvalues, 0 and 3. The 
eigenspace associated with 3 is of dimension |. The 
matrix is not diagonalizable. 

A = 0,2 The matrix is diagonalizable. 

A = 0,2 Insufficient number 
guarantee diagonalizability 


of eigenvalues to 


1 3 
P= k i (The answer is not unique.) 


1 (The answer is not unique.) 


| = 
| 


(The answer is not unique.) 


(The answer is not unique.) 


3 =] =§ 
29. P=|2 2 10] (The answer is not unique.) 
0 0 2 
31. A is not diagonalizable. 
4 0 0 0 
33. P= i : : : (The answer is not unique.) 
1 1 1 1 


35. {(1, —1), , 1)} 37. {(—1 + x), x} 


41. ee | 
126 253 


39. (a) and (b) Proof 
384 256 —384 
43. | —384 -—512 1152 
—128 —256 640 
45. (a) True. See the proof of Theorem 7.4, 
pages 436-437. 
(b) False. See Theorem 7.6, page 442. 


47. Yes, the order of elements on the main diagonal may 
change. 


49-55. Proof 
57. The eigenvector for the eigenvalue A = k is (0,0). By 


Theorem 7.5, the matrix is not diagonalizable because it 
does not have two linearly independent vectors. 


Section 7.3 (page 456) 
1. Symmetric 3. Not symmetric 
5. Symmetric 7. 4 = 2,dim = 1 
A = 4, dim = 1 
9. AX = 2, dim = 2 11. A = —2, dim = 2 
A = 3,dim = 1 A= 4,dim=1 
13. A = —I1,dim = 1 
A=1+4+ V2, dim = 1 
A=1- V2, dim = 1 
15. Orthogonal 17. Not orthogonal 
19. Orthogonal 21. Orthogonal 
oe J2/2 | 
-J/2/2 2/2 


(The answer is not unique.) 


Answer Key AS55 


he oe J3/3 ya 
; ifs af 3/3 
(The answer is not unique.) 
2 _1 2 
3 3 3 
27. P= 3 3 3 (The answer is not unique.) 
2 _2 1 
3 3 3 
— /3/3 -—/2/2 J6/6 
29. | — /3/3 J2/2 6/6 
J3/3 0 6/3 
(The answer is not unique.) 
s/2/2 0 2/2 0 
—J/2/2 2) 2. 
a. p= |v & 


0 aff Oo (2/2 
0 -V2/2 6 (2)? 
(The answer is not unique.) 
33. (a) True. See Theorem 7.10, page 453. 
(b) True. See Theorem 7.9, page 452. 


35. Proof 37. Proof 
39, ast = ( : 1 )| one sin 
cos? 6 + sin? 6/ | —sin@ cos @ 
7 cos @ sin ‘| _ar 
—sin@ cos é 


41. Proof 
Section 7.4 (page 472) 


20 10 
1, x, = 5\ *3 119 


84 60 5 
3. x, =| 12], x, = | 84 s.x-7|1| 
6 6 
8 960 2340 
7.x = t/4 9. x, =| 90]|,x,=] 720 
1 30 > 
900 2200 
11. x, =|] 60],x,=] 540 
50 30 


A56 = = Answer Key 
13. y, = Cye" 15. y, = Cie" 17. y, = Cye* 
yn = Coe’ V2 = Cye* y, = Coe" 
y3 = Ce y3 = C,e 
19. y, = Cye! — 4C,e7" 21. y, Cie + Cye* 
V2 = Cye” yy = —Cye * + Cye* 
23. y, = 3C\e727 —  5Cye**7 -— Ce 
Vy = 2C,e~2" + 10C,e4* + 2C,e% 
y3 = 2C,e* 
25. y, = Cie’ — 2C,e”" — 7C,e*" 
y> = Cye7" + 8C3e*" 
¥3 = 2C3e* 
27. y= y, + y> 29. y," = Yo 
yn! = Yo yo J3 
J3 —4y, 
1 0 9 5 0 5 
31. 33 35. 
lo oi Ls al 13 10] 
3 
5 13. 33 
7 A= 9, A= : 
: 3 , _ Le 7 | 
= 3 
2 
5 5 
A= > Ae => A, = 4, A, = 16 
tt 3. 1 V3 
_ | 710 ve _ 2 2 
p= p= 
a 1. 31 
/10 /10 2 2 
3 4 
_ | 16 —12 5 5 
41. a=| 3 ae 0, A, = 25, P E ] 
5 5 
43. Ellipse, 5(x’)? + 15(y’)? — 45 = 0 
45. Hyperbola, —25(x’)? + 15(y’)? — 50 = 0 


47. 
49. 


51. 


Parabola, 4(y’)? + 4x’ + 8y’+4=0 
Hyperbola, 
5 [-@’? + (y’)? — 32x’ — /2y’ + 6| = 


a = 1 0 
A=/-1 3 0}, 
0 0 8 


2(x’)? + 4(y’? + 82’? — 16 = 0 


1 0 0 
53. A = | 0 2 1 
0 1 2 
(xP + (y’? + 3-1 = 0 


55. Let P= b 
Cc 


Review Exercises — Chapter 7 
1. 


-@ = 1Ph—3P =O 
(c) A basis for A = 1 is {(1, 


y| be a 2 x 2 orthogonal matrix such 


that |P| = 1. Define 6 € (0, 277) as follows. 
G) Ifa =1,thenc = 0, b =0, and d = 1, so let 6 = 0. 
di) Ifa = —1, thenc = 0, b = 0, and d = —1, so let 
0= 7. 
(iii) If a = O and c > O, let 6 =arccos(a), 0 < 0 < 77/2. 
(iv) If a = O and c < 0, let 0 =27 — arccos(a), 
3n/2 < 0 < 20. 
(v) Ifa <Oandc > 0, let 6 =arccos(a), 
n/2<0< 7. 
(vi) If a < O and c <0, let 9=2a — arccos(a), 
T< 0 < 37/2. 
In each of these cases, confirm that 
ae a b| __|cos@ —sin 6 
7 I: | - i 0 cos At 
(page 474) 
(a) 27-9 =0 (b) A= -3,A = 3 
(c) A basis for A = —3 is (1, —5) and a basis for 
A = 3is (1, 1). 


. (a) (A- 4)(A — 87 = (b)A=4,A=8 
(c) A basis for A = 4 is (1, —2, —1) and a basis for 
A = 8 is (4, —1, 0), (3, 0, 1). 
. (a) (A — 2)(A — 3) A —- 1) = 0 


(b) A= 1,A=2,A=3 
(c) A basis for A = 1 is (1, 2, —1), a basis for A = 2 
is (1, 0, 0), and a basis for A = 3 is (0, 1, 0). 
(b)A=1,rA=3 
=1,0,0), G; 0, 1, =1)} 
and a basis for A = 3 is {(1, 1, 0, 0), (0, 0, 1, 1)}. 


. Not diagonalizable 


1 0 1 
P= 10 1 0} (The answer is not unique.) 
1 0 -i 


13. 


15. 


17. 


19. 


21. 


23. 
25. 


29. 


31. 


33. 
39. 


43. 


45. 


47. 


The characteristic equation of 


ie 6 —sin ‘| 

A". 

sin 0 cos 0 

is A* — (2cos 6)A + 1 = 0. The roots of this equation 
are A =cos@ + /cos*@-— 1. If 0 < 6< qa, then 
—1 < cos @ < 1, which implies that cos? 6 — | is 
imaginary. 

A has only one eigenvalue, A = 0, and the dimension of 
its eigenspace is |. So, the matrix is not diagonalizable. 
A has only one eigenvalue, A = 3, and the dimension of 
its eigenspace is 2. So, the matrix is not diagonalizable. 


ol 

P= 

1 0 

Because the eigenspace corresponding to A = 1 of 


matrix A has dimension 1, while that of matrix B has 
dimension 2, the matrices are not similar. 


Both orthogonal and symmetric 


Symmetric 27. Neither 
2 _ 1 
5 
c= 1 2 (The answer is not unique.) 
Rae 
a ui 
V2 Fo) 
P= 0 1 0 
aad. 9 + 
a2 «f 2 
(The answer is not unique.) 
32 32 111 
(3,3) 3s. (3, 3) a7. (53,4) 
4 5 
(4, 6 x) 41. Proof 
0 1 9 
o> |e gf Ay = 9, Ag = 3 
4 
= Be pe B= ie =| 
20 -4/ 152. —88 


(a) and (b) Proof 49. Proof 


53. 


55. 


57. 


59, 


63. 


67. 


oe 


Answer Key AS7 


1 1 
_ |e 2 
i es 

$2 2 

(a) a=b=c=0 


(b) Dim = lifa #0, b#0, c #0. 
Dim = 2 if exactly one is 0. 
Dim = 3 if exactly two are 0. 

(a) True. See “Definitions of Eigenvalue and 
Eigenvector,’ page 422. 

(b) False. See Theorem 7.4, page 436. 


(c) True. See “Definition of a Diagonalizable Matrix,” 
page 435. 


100 25 2 
1 ash 3 Losh La 


4500 1500 24 
x, =| 300}, x, =| 4500], x = 7} 12 
50 50 1 
1440 6588 
X, =| 108}, x, = | 1296 
90 81 
y, = —2C, + Coe’ 65. y, = Cye’ + Cie 
w= C, Yn = Cie’ — Coe! 
¥3 = C; 
3 
1 = 
2 
= 15 
= 1 
2 
ees 
V2 4/2 
p= 
A te 
v2 <2 


A58 = Answer Key 


o i 
69. A = 
1 
2 0) 
tL 
ea) 2 
jit 
V2 2 


Cumulative Test — Chapters 6 and 7 


. Yes, T is a linear transformation. 


(page 479) 


. No, T is not a linear transformation. 
tay C10) <b): S,4) 

. {(s, s, —t, t): s, tare real} 

. (a) Span{(0, — 1, 0, 1), (1, 0, — 1, 0)} 


(b) Span{(1, 0), (0, 1)} 
(c) Rank = 2, nullity = 2 


an & & NY = 


1 1 0 
6. | 0 1 1 
1 Q =I 


Be aeest 
; ‘| (1, 1) = (0,0), ™(—2, 2) = (-2, 2) 
» 2 


8. T(x, y) = (Gx + 9y, —3x + yy) 
—]1 = 
9.| 0 
2 


2 
1 
1 
i =3 
10. @a=|i | 


= 1 
Oe -| 6 | 


, T(0, 1) = (1, 0, 1) 


b P= 4 
P=), 4 


of? 


©) [v], = | al IW), = Ee 


= 
nN 


15. 


16. 


17. 


18. 


19. 


20. 


21. 


1 
A = | (three times), | 0 
0 
3 1 ' : 
P= i 1 (The answer is not unique.) 
{(0, 1, 0), (1, 1, 1), (2, 2, 3)} 
toot 
J2. /2 
i 1 
2 4/2 
i 2 = 
v3 2 V6 
= ee ree 
V3 V6 
oer See 
V3 /2 V6 
y, = Ce’ 
yy = Cye* 
4 -4 
Ey) 
1800 6300 
x, =| 120], x, =|} 1440 
60 48 


A is an eigenvalue of A if there exists a nonzero vector 
x such that Ax = Ax. x is called an eigenvector of A. If 
A is an n X n matrix, then A can have n eigenvalues, 
possibly complex and possibly repeated. 


P is orthogonal if P~! = P’. The possible eigenvalues of 
the determinant of an orthogonal matrix are | and — 1. 


22-26. Proof 


27. 


0 is the only eigenvalue. 


INDEX 


Abstraction, 191 
Addition 
of matrices, 48 
of vectors, 180, 182, 191 
Additive identity 
of a matrix, 62 
of a vector, 186, 191 
properties of, 182, 185, 186 
Additive inverse 
of a matrix, 62 
of a vector, 186, 191 
properties of, 182, 185, 186 
Adjoining two matrices, 75 
Adjoint of a matrix, 158 
Age distribution vector, 458 
Age transition matrix, 459 
Algebra of matrices, 61 
Algebraic properties of the cross 
product, 338 


Angle between two vectors, 282, 286, 296 


Approximation 
Fourier, 346, 348 
least squares, 342, 345 
nth-order Fourier, 347 
Area of a triangle in the xy-plane, 164 
Associative property 
of matrix addition, 61 
of scalar multiplication, 182, 191 
of vector addition, 182, 191 
Augmented matrix, 15 
Axioms for vector space, 191 


B 

Back-substitution, 6, 19 
Bases and linear dependence, 225 
Basis, 221 

change of, 252 

coordinates relative to, 249 

orthogonal, 307 

orthonormal, 307 

standard, 222, 223, 224 

tests for, 229 
Basis for the row space of a matrix, 234 
Bessel’s Inequality, 353 
Block multiply two matrices, 60 


C 


Cancellation properties, 82 


Cauchy, Augustin-Louis (1789-1857), 285 


Cauchy-Schwarz Inequality, 285, 299 

Cayley-Hamilton Theorem, 175, 433 

Change of basis, 252 

Characteristic equation of a matrix, 153, 
426 


Characteristic polynomial of a matrix, 175, 


426 
Closed economic system, 106 
Closure 
under scalar multiplication, 182, 185, 
191 
under vector addition, 182, 185, 191 
Coded row matrix, 102 
Codomain of a mapping function, 361 
Coefficient, 2, 55 
leading, 2 
Coefficient matrix, 15 
Cofactor, 124 
expansion by, 126 
matrix of, 158 
sign patterns for, 124 
Column 
matrix, 47 
of a matrix, 14 
space, 233 
subscript, 14 
vector, 47, 232 
Column-equivalent, 135 
Commutative property 
of matrix addition, 61 
of vector addition, 182, 185, 191 
Companion matrix, 475 
Component of a vector, 180 
Composition of linear transformations, 
390, 391 
Condition for diagonalization, 437 
Conditions that yield a zero 
determinant, 136 
Conic, 265, 266, 267 
rotation, 269 
Consistent system of linear equations, 5 
Constant term, 2 
Contraction, 408 
Coordinate matrix of a vector, 249 
Coordinates 
relative to an orthonormal basis, 310 
of a vector relative to a basis, 249 
Counterexample, A6 


Cramer’s Rule, 162, 163 

Cross product of two vectors, 336 
algebraic properties of, 338 
geometric properties of, 339 

Cryptogram, 102 

Cryptography, 102 


D 
Determinant, 122, 123, 125 
evaluation by elementary column 
operations, 136 
evaluation by elementary row 
operations, 134 
expansion by cofactors, 126 
of an inverse matrix, 146 
of an invertible matrix, 145 
of a matrix product, 143 
properties of, 142 
of a scalar multiple of a matrix, 144 
of a transpose, 148 
of a triangular matrix, 129 
of a 2 x 2 matrix, 123 
zero, 136 
Diagonal matrix, 128 
Diagonalizable, 435 
Diagonalization 
condition for, 437 
problem, 435 
sufficient condition for, 442 
Difference of two vectors, 181, 184 
Differential operator, 370 
Dimension 
of the solution space, 241 
of a vector space, 227 
Direct sum of subspaces, 276, 323 
Directed line segment, 180 
Distance between two vectors, 281, 282, 
296 
Distributive property, 63 
of scalar multiplication, 182, 185, 191 
Domain of a mapping function, 361 
Dot product of two vectors, 282 
properties of, 283 
Dynamical systems, 477 


E 
Eigenspace, 424, 431 
Eigenvalue, 152 
of a linear transformation, 431 


A59 


A60~—=_/ndex 


of a matrix, 421, 422, 426 
multiplicity of, 428 
of a symmetric matrix, 447 
of a triangular matrix, 430 
Eigenvalue problem, 152, 421 
Eigenvector, 152 
of a linear transformation, 431 
of a matrix, 421, 422, 426 
Electrical network, 35 
Elementary column operations, 135 
used to evaluate a determinant, 136 
Elementary matrices are invertible, 90 
Elementary matrices for linear 
transformations in the plane, 407 
Elementary matrix, 87 
Elementary row operations, 15 
used to evaluate a determinant, 134 
Elimination 
Gaussian, 7 
with back-substitution, 19 
Gauss-Jordan, 22 
Ellipse, 266 
Ellipsoid, 469 
Elliptic 
cone, 470 
paraboloid, 470 
Encoded message, 102 
Entry of a matrix, 14 
Equality 
of two matrices, 47 
of two vectors, 180, 183 
Equivalent 
conditions, 93 
conditions for a nonsingular matrix, 147 
systems of linear equations, 7 
Euclidean 
inner product, 293 
n-space, 283 
Existence of an inverse transformation, 
393 
Expansion, 408 
by cofactors, 126 
External demand matrix, 106 


F 
Fibonacci, Leonard (1170-1250), 478 
Fibonacci sequence, 478 
Finding eigenvalues and eigenvectors, 427 


Finding the inverse of a matrix by 
Gauss-Jordan elimination, 76 
Finite dimensional vector space, 221 
Fixed point of a linear transformation, 373 
Forward substitution, 95 
Fourier 
approximation, 346, 348 
coefficients, 311, 348 
series, 349 
Fourier, Jean-Baptiste Joseph (1768-1830), 
308, 347 
Free variable, 3 
Fundamental subspace, 326 
of a matrix, 326, 327 
Fundamental Theorem of Symmetric 
Matrices, 453 


G 
Gaussian elimination, 7 
with back-substitution, 19 
Gauss-Jordan elimination, 22 
General solution of a differential 
equation, 263 
Geometric properties of the cross product, 
339 
Gram, Jorgen Pederson (1850-1916), 312 
Gram-Schmidt orthonormalization process, 
312 
alternative form, 316 


H 

Homogeneous 

linear differential equation, 262 

solution of, 262, 263 

system of linear equations, 24 
Householder matrix, 87 
Hyperbola, 266 
Hyperbolic paraboloid, 470 
Hyperboloid 

of one sheet, 469 

of two sheets, 469 


i, j, k notation, 279 
Idempotent matrix, 98, 435 
Identically equal to zero, 264 
Identity matrix, 65 

of order n, 65 

properties of, 66 


Identity transformation, 364 
Image of a vector after a mapping, 361 
Inconsistent system of linear 
equations, 5 
Induction hypothesis, A2 
Inductive, 125 
Infinite dimensional vector space, 221 
Initial point of vector, 180 
Inner product space, 293 
Inner product of vectors, 292 
Euclidean, 292 
properties of, 293 
Input, 105 
Input-output matrix, 105 
Intersection of two subspaces is a 
subspace, 202 
Inverse 
of a linear transformation, 392 
of a matrix, 73 
algorithm for, 76 
determinant of, 146 
given by its adjoint, 159 
of a product of two matrices, 81 
properties of, 79 
of a product, 81 
of a transition matrix, 253 
Invertible 
linear transformation, 392 
matrix, 73 
determinant of, 145 
property of, 91 
Isomorphic, 384 
Isomorphic spaces and dimension, 384 
Isomorphism, 384 


J 
Jacobian, 173 
Jordan, Wilhelm (1842-1899), 22 


K 
Kernel, 374 
Kernel is a subspace of V, 377 
Kirchhoff’s Laws, 35 


L 
Lagrange’s Identity, 351 
Leading 
coefficient, 2 
one, 18 
variable, 2 


Least squares 
approximation, 342, 345 
problem, 321 
regression analysis, 108 
regression line, 109, 321 


Legendre, Adrien-Marie (1752-1833), 316 


Lemma, 254 
Length 

of a scalar multiple, 279 

of a vector, 277 

of a vector in R”, 278 
Leontief input-output model, 105 


Leontief, Wassily W. (1906-1999), 105 


Linear combination, 55, 186, 207 
Linear dependence, 212, 213 
test for, 214 
Linear differential equation, 262, 461 
homogeneous, 262 
nonhomogeneous, 262 
solution of, 262, 263 
Linear equation 
in n variables, 2 
solution of, 2 
system of, 4 
equivalent, 7 
in three variables, 2 
in two variables, 2 
Linear independence, 212, 213 
test for, 214 
Wronskian test for, 264 
Linear operator, 363 
Linear transformation, 362 
composition of, 390, 391 
contraction, 408 
eigenvalue, 421, 422, 426, 431 
eigenvector, 421, 422, 426, 431 
expansion, 408 
fixed point of, 373 
given by a matrix, 367 
identity, 364 
inverse of, 392 
isomorphism, 384 
kernel of, 374 
magnification, 414 
nullity of, 380 
nullspace of, 377 
one-to-one, 382, 383 
onto, 383 


in the plane, 407 
projection, 369 
properties of, 364 
range of, 378 
rank of, 380 
reflection, 407, 419 
rotation, 369 
shear, 409 
standard matrix for, 388 
zero, 364 
Lower triangular matrix, 93, 128 
LU-factorization, 93 


M 
Min 224 
standard basis for, 224 
Magnification, 414 
Magnitude of a vector, 277, 278 
Main diagonal, 14 
Map, 361 
Matrix, 14 
addition of, 48 
adjoining, 76 
adjoint of, 158 
age transition, 459 
algebra of, 61 
augmented, 15 
block multiply two, 60 
characteristic equation of, 426 
characteristic polynomial of, 426 
coefficient, 15 
cofactor of, 124 
of cofactors, 158 
column of, 14 
companion, 475 
coordinate, 249 
determinant of, 122, 123, 125 
diagonal, 128 
diagonalizable, 435 
eigenvalue of, 152, 421, 422, 426 
eigenvector of, 152, 421, 422, 426 
elementary, 87, 407 
entry of, 14 
equality of, 47 
external demand, 106 
fundamental subspaces of, 326, 327 
householder, 87 
idempotent, 98, 435 


Index 


identity, 65 
identity of order n, 65 
input-output, 105 
inverse of, 73 
invertible, 73 
for a linear transformation, 388 
lower triangular, 93, 128 
main diagonal, 14 
minor of, 124 
multiplication of, 49 
nilpotent, 121, 435 
noninvertible, 73 
nonsingular, 73 
nullspace, 239 
operations with, 46 
orthogonal, 151, 358, 449 
output, 106 
partitioned, 54 
product of, 50 
of the quadratic form, 464 
rank of, 238 
real, 14 
reduced row-echelon form, 18 
row of, 14 
row-echelon form of, 18 
row-equivalent, 90 
row space, 233 
scalar multiple of, 48 
similar, 402, 435 
singular, 73 
size, 14 
skew-symmetric, 72, 151 
spectrum of, 447 
square of order n, 14 
state, 100 
stochastic, 99 
symmetric, 68, 446 
trace of, 58, 434 
transition, 252, 399 
transpose of, 67 
triangular, 128 
upper triangular, 93, 128 
zero, 62 

Matrix form for linear regression, 111 


A61 


Matrix of T relative to the bases B and B’, 


394, 396 
Matrix of transition probabilities, 99 
Method of least squares, 109 


A62~ = /[ndex 


Minor, 124 
Multiplication of matrices, 49 
Multiplicity of an eigenvalue, 428 


N 
Negative of a vector, 181, 184 
Network 
analysis, 33 
electrical, 35 
Nilpotent 
of index k, 121 
matrix, 121, 435 
Noncommutativity of matrix 
multiplication, 64 
Nonhomogeneous linear differential 
equation, 262 
Noninvertible matrix, 73 
Nonsingular matrix, 73 
Nontrivial solution, 212 
Norm of a vector, 278, 296 
Normal equation, 328 
Normalized Legendre polynomial, 316 
Normalizing a vector, 280 


n-space, 183 
nth-order Fourier approximation, 347 
Nullity 


of a linear transformation, 380 
of a matrix, 239 

Nullspace, 239, 377 

Number of solutions 
of a homogeneous system, 25 
of a system of linear equations, 

6, 67 
Number of vectors in a basis, 226 


O 
One-to-one linear transformation, 382, 383 
Onto linear transformation, 383 
Open economic system, 106 
Operations that lead to equivalent 
systems of equations, 7 

Operations with matrices, 46 
Opposite direction parallel vectors, 279 
Ordered n-tuple, 183 
Ordered pair, 180 
Orthogonal, 287, 296, 306 

basis, 307 

complement, 322 


diagonalization of a symmetric matrix, 
454 
matrix, 151, 358, 449 
property of, 450 
projection, 301, 373 
projection and distance, 302, 326 
sets are linearly independent, 309 
subspaces, 321 
properties of, 323 
vectors, 287, 296 
Orthogonally diagonalizable, 453 
Orthonormal, 306 
basis, 307 
Output, 105 
Output matrix, 106 
Overdetermined linear system, 45 


P 
P,,, 193, 194 

standard basis for, 223 
Parabola, 267 
Parallel vectors, 279 
Parameter, 3 
Parametric representation, 3 
Parseval’s equality, 319 
Partitioned matrix, 54 
Plane, linear transformations in, 407 
Polynomial curve fitting, 29 
Preimage of a mapped vector, 361 
Preservation of operations, 362 
Principal Axes Theorem, 465 
Principle of Mathematical Induction, A2 
Product 

cross, 336 

dot, 282 

properties of, 283 

inner, 292 

triple scalar, 350, 355 

of two matrices, 50 
Projection onto a subspace, 324 
Projection in R?, 369 
Proof by contradiction, A4 
Proper subspace, 200 
Properties of 

additive identity and additive 

inverse, 186 
the cross product 
algebraic, 338 


geometric, 339 
the dot product, 283 
inner products, 295 
inverse matrices, 79 
linear transformations, 364 
matrix addition and scalar 
multiplication, 61 
matrix multiplication, 63 
orthogonal subspaces, 323 
scalar multiplication, 195 
similar matrices, 402 
transposes, 68 
vector addition and scalar 
multiplication, 182, 185 
zero matrices, 62 
Property 
of invertible matrices, 91 
of linearly dependent sets, 217 
of orthogonal matrices, 450 
of symmetric matrices, 452 
Pythagorean Theorem, 289, 299 


Q 
QR-factorization, 312, 356 


Quadratic form, 464 


R 
R", 183 
coordinate representation in, 249 
scalar multiplication, 183 
standard basis for, 222 
standard operations in, 183 
subspaces of, 202 
vector addition, 183 
Range 
of a linear transformation, 378 
of a mapping function, 361 
Rank 
of a linear transformation, 380 
of a matrix, 238 
Real matrix, 14 
Real Spectral Theorem, 447 
Reduced row-echelon form of a matrix, 18 
Reflection, 407, 419 
Representing elementary row 
operations, 89 
Rotation 
of a conic, 269 
in R?, 369 


Row 
matrix, 47 
of a matrix, 14 
space, 233 
subscript, 14 
vector, 47, 232 
Row and column spaces have equal 
dimensions, 237 
Row-echelon form 
of a matrix, 18 
of a system of linear equations, 6 
Row-equivalent, 16 
Row-equivalent matrices, 90 
Row-equivalent matrices have the same 
row space, 233 


S 
Same direction parallel vectors, 279 
Scalar, 48 
Scalar multiple, length of, 279 
Scalar multiplication, 48, 181, 191 
associative property, 182, 191 
closure, 182, 185, 191 
distributive property, 182, 185, 191 
identity, 182, 185, 191 
properties of, 182, 185, 195 
in R”, 183 
Schmidt, Erhardt (1876-1959), 312 
Schwarz, Hermann (1843-1921), 285 
Shear, 409 
Sign pattern for cofactors, 124 
Similar matrices, 402, 435 
properties of, 402 
Similar matrices have the same 
eigenvalues, 436 
Singular matrix, 73 
Size of a matrix, 14 
Skew-symmetric matrix, 72, 151 
Solution of 
a homogeneous system, 239 
a linear differential equation, 262 
a linear equation, 2 
a linear homogeneous differential 
equation, 263 
a nonhomogeneous linear system, 243 
a system of linear equations, 4, 244 
trivial, 24 
Solution set, 3 


Solution space, 240 
dimension of, 241 


Span 
of S,, 211 
of a set, 211 


Span (S) is a subspace of V, 211 
Spanning set, 209 
Spectrum of a symmetric matrix, 447 
Square of order n, 14 
Standard 
forms of equations of conics, 266, 267 
matrix for a linear transformation, 388 
operations in R”, 183 
spanning set, 210 
unit vector, 279 
Standard basis 
for M,, »» 224 
for P,,, 223 
for R”, 222 
State matrix, 100 
Steady state, 101, 174 
Steady state probability vector, 475 
Steps for diagonalizing an n x n square 
matrix, 439 
Stochastic matrix, 99 
Subspace(s) 
direct sum of, 276, 323 
proper, 200 
of R”, 202 
sum of, 276 
test for, 199 
of a vector space, 198 
zero, 200 
Subtraction of vectors, 181, 184 
Sufficient condition for 
diagonalization, 442 
Sum 
of rank and nullity, 380 
of two subspaces, 276 
of two vectors, 180, 183 
Sum of squared error, 109 
Summary 
of equivalent conditions for square 
matrices, 246 
of important vector spaces, 194 
Symmetric matrix, 68, 446 
eigenvalues of, 447 
Fundamental Theorem of, 453 


Index A63 


orthogonal diagonalization of, 454 
property of, 452 
System of 
equations with unique solutions, 83 
first-order linear differential 
equations, 461 
linear equations, 4 
consistent, 5 
equivalent, 7 
inconsistent, 5 
number of solutions, 6, 67 
row-echelon form, 6 
solution of, 4, 244 
m linear equations in n variables, 4 


T 


Terminal point of a vector, 180 
Test for 
collinear points in the xy-plane, 165 
coplanar points in space, 167 
linear independence and linear 
dependence, 214 
a subspace, 199 
Tetrahedron, volume of, 166 
Three-point form of the equation of a 
plane, 167 
Trace 
of a matrix, 58, 434 
of a surface, 468 
Transformation matrix for nonstandard 
bases, 394 
Transition matrices, 399 
Transition matrix, 252 
from B to B’, 255 
inverse of, 253 
Translation, 373 
Transpose of a matrix, 67 
determinant of, 148 
properties of, 68 
Triangle Inequality, 287, 288, 299 
Triangular matrix, 128 
determinant, 129 
eigenvalues for, 430 
lower, 93, 128 
upper, 93, 128 
Triple scalar product, 350, 355 
Trivial solution, 24, 212 


A64 = [ndex 


Two-point form of the equation of a line, 
165 


U 

Underdetermined linear system, 45 
Uniqueness of basis representation, 224 
Uniqueness of an inverse matrix, 73 
Unit vector, 278, 296 

in the direction of a vector, 280, 296 

standard, 279 
Upper triangular matrix, 93, 128 


V 
Variable 
free, 3 
leading, 2 
Vector, 180, 183, 191 
addition, 180, 182, 185, 191 
additive identity, 186, 191 
additive inverse, 186, 191 
age distribution, 458 
angle between, 282, 286, 296 
column, 47, 233 
component of, 180 
cross product, 336 
distance between, 282, 296 


dot product, 282 

equality of, 180, 183 

initial point of, 180 

length of, 277 

linear combination of, 186, 207 
magnitude of, 277 

negative of, 181, 184 

norm, 278, 296 

orthogonal, 287, 296 

parallel, 279 

in the plane, 180 

row, 47, 232 

scalar multiplication, 181, 182, 183, 191 
standard unit, 279 

steady state probability, 475 
subtraction, 181, 184 

terminal point of, 180 

unit, 278, 280, 296 

zero, 180, 184 


Vector addition, 180, 182, 183, 191 


associative property, 182, 185, 191 
closure, 182, 185, 191 

commutative property, 182, 185, 191 
properties of, 182, 185 

in R", 183 


Vector addition and scalar 
multiplication in R”, 185 
Vector space, 191 
basis for, 221 
finite dimensional, 221 
infinite dimensional, 221 
isomorphic, 384 
spanning set of, 209 
subspace of, 198 
summary of, 194 
Volume of a tetrahedron, 166 


W 
Weights of the terms in an inner 
product, 294 
Wronski, Josef Maria (1778-1853), 264 
Wronskian, 263 
test for linear independence, 264 


Z 
Zero 
matrix, 62 
properties of, 62 
subspace, 200 
transformation, 364 
vector, 180, 184 


Properties of Matrix Addition and Scalar Multiplication 


If A, B, and C are m X n matrices and c and d are scalars, then the following properties 


are true. 

1.A+B=BtA Commutative property of addition 
2.A+(B+C)=(A+B)4+C Associative property of addition 
3. (cd)A = c(dA) 

4, 1A=A 

5. cA + B)=cA+cB Distributive property 

6. (c+ dA =cA+dA Distributive property 


Properties of Matrix Multiplication 


If A, B, and C are matrices (with orders such that the given matrix products are defined) 
and c is a scalar, then the following properties are true. 


1. A(BC) = (AB)C Associative property of multiplication 
2. A(B + C) = AB + AC Distributive property 
3. (A + B)C =AC + BC Distributive property 


4. c(AB) = (cA)B = A(cB) 


Properties of the Identity Matrix 


If A is a matrix of order m x n, then the following properties are true. 
1. Al,=A 
2.1,4 =A 


m 


Properties of Vector Addition and Scalar Multiplication 


Let u, v, and w be vectors in R”, and let c and d be scalars. 


1. u + visa vector in R”. 6. cu is a vector in R”. 
2.u+v=evtu 7. cu+v) =cu+cv 
3. (ut+v)+w=ut+(v+w) 8. (c + dju=cu+ du 
4,.u+0=u 9. c(du) = (cd)u 
5.u+(—-u) =0 10. 1) =u 


Summary of Equivalent Conditions for Square Matrices 


If A is ann X n matrix, then the following conditions are equivalent. 
. A is invertible. 

. Ax = b has a unique solution for any n x | matrix b. 

Ax = 0 has only the trivial solution. 

. A is row equivalent to J,,. 

|A| #0 

. Rank(A) =n 

. The n row vectors of A are linearly independent. 

. The n column vectors of A are linearly independent. 
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Properties of the Dot Product 


If u, v, and w are vectors in R” and c is a scalar, then the following properties are true. 
u‘v=v-u 

u-(v+w)=u-vtu-w 

c(u - v) = (cu) - v =u: (cy) 

ve v= |lvP 

v-v = 0,andv- v = Oif and only if v = 0. 
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Properties of the Cross Product 


Types of Vector Spaces 


If u, v, and w are vectors in R? and c is a scalar, then the following properties are true. 


l.uxv=-(vxu) 4,.ux0=0xu=0 
2. ux (v + w) = (ux v) + (ux w) 5. uxu=0 
3. ctu x v) =cuxv=uxcv 6. u- (vx w) =(uxv)-w 


R = set of all real numbers 
R* = set of all ordered pairs 
R? = set of all ordered triples 
R" = set of all n-tuples 
C(— co, co) = set of all continuous functions defined on the real line 
Cl[a, b] = set of all continuous functions defined on a closed interval [a, b] 

P = set of all polynomials 
P., = set of all polynomials of degree < n 

M,,,, = Set of all m x n matrices 

M,,,, = Set of all n x n square matrices 


Finding Eigenvalues and Eigenvectors* 


Let A be ann X n matrix. 

1. Form the characteristic equation |AJ — A| = 0. It will be a polynomial equation of 
degree n in the variable A. 

2. Find the real roots of the characteristic equation. These are the eigenvalues of A. 

3. For each eigenvalue A,, find the eigenvectors corresponding to A; by solving the 
homogeneous system (A,J — A)x = 0. This requires row-reducing an n x n matrix. 
The resulting reduced row-echelon form must have at least one row of zeros. 


*For complicated problems, this process can be facilitated with the use of technology. 


